Get Permission Yarava, Pradeep M.S.S, and Rao K: Daptomycin susceptibility in enterococci isolated from urinary samples in a tertiary care hospital


Introduction

Enterococci are gram positive cocci arranged in pairs and short chains, which in the Lancefield scheme are included in Group D streptococci which includes both enterococcal and non-enterococcal speices.1 From 1980 Enterococci were classified in their own genus due to presence of sufficient differences from other Streptococci which contains at least 12 species2 and this classification has been modified constantly, with several species being added like E.faecalis, E.faecium, E.cecorum, E.columbae, E.saccharolyticus, E.dispar, E.sulfureus, E.seriolicida and E.flavescens.3 Enterococci are facultative anaerobes that can grow under the extreme conditions like in the presence of 6.5% NaCl, pH 9.6, temperature ranging from 100C to 450C, presence of 40% bile and they also can hydrolyse esculin and L-pyrroldonyl –β-naphthol .4 These are a part of normal flora of gastrointestinal tract, oral cavity and vagina in humans. E.faecalis (80-90%) and E.faecium (5-10%)are the predominant species encountered in various human infections like urinary tract infections (UTI), bacteremia, endocarditis, catheter related infections, wound and soft tissue infections, meningitis, respiratory tract infections, neonatal sepsis, intra abdominal and pelvic infections.5 Enterococci are not virulent intrinsically like Staphylococcus aureus and Streptococcus pyogenes but several factors have been described like extracellular surface protein (Esp) which contribute to the pathogenesis and colonization in humans and these strains contain esp genes which encode for these proteins.6, 7 E.faecalis has fsr locus due to which it expresses quorum sensing system for production of extracellular serine proteases and gelatinase (Gel E) which are associated with enhanced enterococcal virulence by helping them in dissemination. The same fsr locus also codes for biofilm formation in E.faecalis which helps to colonize and infect urinary and vascular catheter and heart valves.8 Some strains of E.faecalis also produce plasmid mediated haemolysins though the role of haemolysin production in enterococcal pathogenicity in humans is not determined.9 The most striking feature of enterococci is their relative and absolute resistance to a variety of antibiotics which are commonly used to treat infections with gram positive organisms.10, 11 (Table 1 )

Table 1

Showing intrinsic and acquired drug resistance in enterococci

Antimicrobial resistance in Enterococci
Intrinsic resistance 1. Aminoglycosidic aminocyclitols(low level) 2. β- Lactams(relatively high MICs) 3. Lincosamides (low level) 4. Trimethoprim –sulfamethoxazole (in vivo only) 5. Quinpristin/dalfopristin (E.faecalis)
Acquired resistance 1. Aminoglycosidic aminocyclitols(high level) 2. β- Lactams (altered PBPs) 3. Cell wall active agents (tolerance) 4. Fluoroquinolones 5. Lincosamides (high level) 6. Macrolides 7. Penicillin and ampicillin 8. Tetracyclines 9. Vancomycin

Apart from intrinsic resistance to various antimicrobial agents in Enterococci, the acquired resistance is mediated by genes encoded on plasmids or transposons. Enterococci have efficient methods of transferring resistance genes not only between themselves but also to different organisms. Tolerance to cell wall active agents also leads to acquired resistance. Enterococcal isolates without prior antibiotic exposure are killed by cell wall active agents but a brief exposure to these drugs may be enough to develop tolerance12 and due to the above reasons combination therapy with cell wall active agents along with aminoglycosides is advised especially in cases of endocarditis or meningitis which generally require bactericidal therapy. There is also development of High level aminoglycoside resistance (HLAR) in enterococcal isolates due to mutations in ribosomes and production of aminoglycoside modifying enzymes which is plasmid mediated.13, 14 Vancomycin Resistant Enterococci (VRE) were first described in late 1980’s, followed by identification of different phenotypes where resistance to vancomycin is due to production of a ligase with an altered specificity which will result in formation of cell wall precursors ending in D-alanine-D-lactate rather than D-alanyl-D-alanine which is the main target for vancomycin.15 Strains exhibiting VanA phenotype show high level resistance to vancomycin and teicoplanin.Van B strains exhibits moderate to high level resistance to vancomycin but are susceptible to teicoplanin. Van C phenotype is seen in E.gallinarum and E.casseliflavus.16 The genes of which are located on chromosomes and are not transferred and Van D and Van E are described in E.faecium which exhibit moderate level of resistance to vancomycin and teicoplanin.17 The incidence of nosocomial infections by VRE is increasing being 11.9% in Asia Pacific and 35.5% in U.S18 and the Centre for Disease Control has also made several recommendations to help the control of spread of VRE strains within hospitals.19

β lactamase producing strains of E.faecium were found initially in 1980 and these strains were isolated in USA also.20

Based on invitro activity, Quinpristin/dalfopristin are used only against E.faecium as E.faecalis is intrinsically resistant. Linezolid is active against both E.faecalis and E.faecium in vitro and is used successfully even in infections caused by VRE and also in cases where Quinpristin/dalfopristin therapy has failed.Linezolid being a bacteriostatic agent should be used with caution in cases of infective endocarditis or meningitis with enterococci where in such situations an bactericidal agent may be preferred.

Daptomycin is a lipopeptide antibiotic which is a fermentation product of Streptomyces roseosporus which was described in 1980’s.21 This drug acts by binding to cell membrane of gram positive organism in a calcium dependent process and disrupts the bacterial cell membrane potential without entering into the cytoplasm.22, 23 It’s in vitro activity is dependent on calcium ions. So 2003 NC-CLS guidelines have recommended to add calcium to standard Cation Adjusted Muller Hinton broth (CAMHB) for microdilution susceptibility testing.24 Daptomycin also inhibits organism embedded in biofilm. Daptomycin has bactericidal activity against stationary phase bacteria and also good in penetrating into biofilm and reducing the bacterial growth.25 Daptomycin is effective in treatment of complicated skin and soft tissue infections, blood stream infection with Staphylococcus aureus and also has bactericidal activity against VRE which is approved by Food and Drug Administration (FDA).26 As a bactericidal agent it is also used in treatment of deep seated infections like infective endocarditis. Higher doses of daptomycin may be beneficial in treatment of invasive VRE infections.27 Daptomycin non susceptible Enterococci (DNSE) were seen before clinical use and during clinical trials also.28 Though there are a lot of case reports of DNSE , only one study has reported the rate of daptomycin non susceptibility in VRE isolates as 15%.29 According to Clinical Laboratory Standards Institute(CLSI) guidelines, minimum inhibitory concentration (MIC) breakpoint of daptomycin for Enterococci is ≤4 mg/l.30 Epidemiological data states that 99.9% of E.faecalis and 99.8% of E.faecium isolates are sensitive to daptomycin31 and decreased daptomycin susceptibility may be attributed to suboptimal dosing. Pharmacokinetic and pharmacodynamic dose response experiments reveal that a minimum dose of 8mg/kg/day of daptomycin is sufficient for its bactericidal activity.32 Studies have revealed that mutations in various metabolic pathways may lead to non-susceptibility to daptomycin but still the mechanism of its resistance is not well understood.33, 34, 35

Accordingly the aim of the present study is to determine the in vitro susceptibility of Enterococci isolated from urine samples to daptomycin by determination of MIC using E-test strips.(Himedia Labs, Mumbai)

Materials and Methods    

This is a prospective observational study conducted in the department of Microbiology, Dr. Pinnamaneni Siddhartha Institute of Medical Sciences and Research Foundation from March 2019 to December 2019 after approval from Institutional ethical committee.

All urinary samples received in the microbiology laboratory were processed as per standard protocols by inoculating them onto sheep blood agar, MacConkey agar and Cysteine Lactose Electrolyte Deficient (CLED) agar, incubated at 35-370C for 18-24 hours. Any growth which showed non - hemolytic colonies of 0.5-1mm on Sheep blood agar, small yellow coloured colonies on CLED agar and magenta pink colonies on MacConkey agar were identified as Enterococci. Further smears from the colonies were gram stained which showed Gram positive cocci in pairs and short chains. Genus enterococcus was identified by negative catalase test, positive bile esculin hydrolysis, growth on 6.5% sodium chloride agar and positive heat tolerance test. Speciation into E.faecalis and E.faecium was done based on growth at 40C and fermentation of sugars like arabinose, sorbitol and raffinose. The strains which didn’t grow at 40C and didn’t ferment arabinose were identified as E.faecalis. The strains which grew at 40C and fermented arabinose were identified as E.faecium.

All the enterococcal isolates were subjected to routine antibiotic sensitivity testing on Muller Hinton Agar (MHA) by Kirby Bauer disc diffusion technique by using the antibiotics vancomycin (30µg), linezolid (30µg), piperacillin-tazobactum (100/10µg), norfloxacin(10µg), nitrofurantoin(300µg), penicillin (10 units), ampicillin (10µg), tetracycline(30µg) and erythromycin(15µg).(Himedia Labs , Mumbai)

All the isolates were further subjected to Epsilometer testing (E-test) of daptomycin according to the manufacturer’s guidelines on MHA. Daptomycin E- test is capable of showing MIC ranging from 0.016 -256mcg/ml MIC was read where the ellipse intersects the MIC scale on the strip and interpreted according to CLSI guidelines. 30 (Fig 1)

Results

A total of 76(100%) non duplicate strains of Enterococci were isolated during the study period of which 25 (33%) were identified as E.faecium and 51 (67%) as E.faecalis.

Most of the Enterococcal isolates (82.8%) were resistant to Norfloxacin, followed by 71% being resistant to tetracycline and 76% of isolates were sensitive to nitrofurantoin. Most of the E.faecium isolates were multidrug resistant.(Table 2) Of the 76 Enterococci isolated only 2(2.63%) were VRE and both the VRE strains isolated were E.faecium. There was no resistance to linezolid including the VRE strains. (Table 2) All the isolates 76 (100%) were sensitive to daptomycin including the VRE strains. (Table 3)

Table 2

ShowingAntibiotic susceptibility of Enterococci isolated (N=76)

Isolate E. faecium ( 25 isolates) E. faecalis (51 isolates)
Susceptible No (%) Resistant No (%) Susceptible No (%) Resistant No (%)
Antibiotic
Penicillin 3 (22) 22 (88) 37 (73) 14(27)
Ampicillin 4(16) 21(84) 42(83) 9(17)
Erythromycin 2(8) 23(92) 28(55) 23(45)
Piperacillin-Tazobactum 4(16) 21(84) 37(73) 14(27)
Nitrofurantoin 13(52) 12(48) 45(88) 6(12)
Norfloxacin 1(4) 24(96) 12(24) 39(76)
Tetracycline 6(24) 19(76) 16(32) 35(68)
Vancomycin 23(92) 2 (8) 51(100) Nil (0)
Linezolid 25 (100) Nil (0) 51(100) Nil (0)
Figure 1

Showing E test ofDaptomycin susceptible enterococci

https://s3-us-west-2.amazonaws.com/typeset-media-server/bede9276-90e7-47b2-b215-04b7922c2ecfimage1.jpeg
Table 3

Showing vancomycin and daptomycin susceptibility

Isolate E. faecium (25 isolates) E. faecalis (51 isolates)
Antibiotic Susceptible No (%) Resistant No (%) Susceptible No (%) Resistant No (%)
Vancomycin 23(92) 2 (8) 51(100) Nil (0)
Daptomycin 25(100) Nil (0) 51(100) Nil (0)

Discussion

Enterococci are natural inhabitants of oral cavity, gastrointestinal tract and female genital tract of both humans and animals. They have now emerged as important nosocomial pathogens. E.faecalis and E.faecium are the two species which are most commonly isolated of which E.faecalis accounts for about 80%. In U.S.A, E.faecalis accounts for 12% of all the nosocomial infections especially UTI.36, 37, 38

Vancomycin remains the main stay for treatment of enterococcal infections; increase in emergence of vancomycin resistance enterococci is of concern as treatment of infections with VRE is difficult. The prevalence of VRE is low in Europe (4%) but is high in North America (33%). In India the prevalence of VRE range from 0-30%.39, 40

Although E.faecalis causes about 80% of infections, resistance to ampicillin and vancomycin is uncommon. But E.faecium is frequently resistant to ampicillin and vancomycin, according to the surveillance data 83% of isolates are vancomycin resistant.41 So currently available treatment for VRE and options to prevent increase in incidence of VRE are linezolid, tigecycline, daptomycin and also newly approved drugs like Tedizolid and oritavancin. The data about the efficacy of these drugs is being limited but resistance to these drugs has also been reported . Some authors have proved the role of combination antibiotic therapy in cases especially in VRE with various combinations like daptomycin and linezolid; daptomycin and ampicillin; daptomycin, gentamycin and β-lactams; Quinpristin – Dalfopristin and ampicillin etc. Limited data is available about the efficacy of daptomycin in vitro activity in urinary isolates of enterococci and ours is a single center prospective observational study conducted to know the invitro activity of daptomycin on urinary isolates of enterococci.

In the present study out of the 76 isolates of enterococci 25(33%) were E.faecium and 51(67%) were E.faecalis.

Of the 76 Enterococci isolated only 2(2.63%) were VRE .All the isolates were sensitive to daptomycin including the VRE strains .Studies from India which mainly focused on daptomycin susceptibility in VRE isolates showed 100% susceptibility to daptomycin and surveillance in U.S hospitals showed greater than 99.5% susceptibility to daptomycin.42, 43, 28

For over a period of 7 years Sader et al evaluated the invitro activity of daptomycin against clinical isolates of enterococci in 34 centers in Europe, Turkey and Isarel and found that the prevalence of VRE was 9.4% and all the isolates (100%) were susceptible to daptomycin.44

A study conducted at a tertiary care hospital in turkey, 52 enterococcal strains from clinical samples showed 100% susceptibility to daptomycin.45 Similar to these results, in our study all the enterococcal strains were susceptible to daptomycin. There is only 0.6% non susceptibility of daptomycin in enterococci according to recent studies.26

Conclusion

Daptomycin is a cyclic lipopeptide antibiotic with potent bactericidal activity against gram positive organisms including multidrug resistant strains. Vancomycin remains the main stay of treatment for serious enterococcal infections. But due to inadvertent use of vancomycin there is emergence of VRE since late 1980’s. This study shows growing concern for increasing antibiotic resistance in enterococcal isolates and treatment of these infections with daptomycin is invited as there are few reports of daptomycin non susceptible enterococci (DNSE).

Our study mainly focused on susceptibility of enterococcal isolates in urinary tract infections to daptomycin. Mode of action of daptomycin is different from glycopeptides and its activity is not influenced by Van genes of enterococci. Daptomycin is primarily eliminated by kidney and approximately 52% is excreted into urine after intravenous administration.

To conclude all the strains of enterococci isolated from urine samples were susceptible to daptomycin irrespective of sensitivity to vancomycin hence daptomycin can be used as a safe and effective alternative drug to treat enterococcal infections including VRE which has been showed by various studies using CLSI breakpoint of ≤4 mg/l. However the yield of daptomycin has to be increased by combined work of various disciplines like genetics and biochemical engineering to reduce the cost of large scale production of daptomycin. So we believe that daptomycin is a valuable treatment option for UTI’s, the usage of which can reduce the rates of VRE infections.

Conflict of Interest

None.

Source of funding

None.

References

1 

R. H. Deibel The group D streptococciBacteriological Rev1964283330

2 

K.H. Schleifer R. Kilpper-Bälz Molecular and Chemotaxonomic Approaches to the Classification of Streptococci, Enterococci and Lactococci: A ReviewSystematic Appl Microbiol1987101119

3 

R R Facklam D F Sahm Teixeiralm Enterococcus P R Murray E J Baron M A Pfaller etal Manual of Clinical Microbiology.7thedWashington,DCAm Soc Microbiol1999297305

4 

B Murray The life and times of the EnterococcusClin Microbiol Rev199034665

5 

G Mandell R Douglas J Bennett R Dolin Enterococcus Species, Streptococcus bovis and Leuconostoc Species. In: Mandell, Douglas, and Bennett’s principles and practices of infectious diseasesElsevier/Churchill LivingstoneNew York200524112421

6 

S K Pillai G Sakoulas Goldhs fsr-mediated catabolic repression of biofilm in Enterococcus faecalisJ Infect Dis2004

7 

T. M. Coque High occurrence of esp among ampicillin-resistant and vancomycin-susceptible Enterococcus faecium clones from hospitalized patientsJ Antimicrobial Chemoth200250610351038

8 

Rjl Willems W Homan J Top Varient esp gene as a marker of a distinct genetic lineage of vancomycin - susceptible Enterococcus faecium spreading in hospitalsLancet2001357853855

9 

Y Ike H Hashimoto D B Clewell Hemolysin of Streptococcus faecalis subspecies zymogenes contributes to virulence in mice.Infect Immunity1984452528530

10 

S A Hoffmann R C Moellering The enterococcus: “Putting the bug in our earsAnn Intern ed198710675761

11 

R C Moellering The Garrod Lecture: The enterococcus: A classic example of the impact of antimicrobial resistance on therapeutic optionsJ Antimicrob Chemother199128112

12 

S Zighelboim-Daum R C Moellering Actor P Daneo-Moore L Higgins ML et al Mechanism and significance of antimicrobial resistance in enterococciAntibiotic Inhibition of Bacterial Cell Surface Assembly and FunctionAmerican Society for MicrobiologyWashington, DC1988603625

13 

R. Leclercq S. Dutka-Malen A. Brisson-Noel C. Molinas E. Derlot M. Arthur Resistance of Enterococci to Aminoglycosides and GlycopeptidesClin Infect Dis1992153495501

14 

G M Eliopoulos B F Farber B E Murray C Wennersten R C Moellering Ribosomal resistance of clinical enterococcal to streptomycin isolates.Antimicrob Agents Chemoth1984253398399

15 

M Arthur Courvalinp Genetics and mechanism of glycopeptide resistance in enterococciAntimicrob Agents Chemother19933715631571

16 

C A Arias Reynoldspr Courvalinp vanC cluster of vancomycin -resistant Enterococcus gallinarum BM4174Antimicrob Agents Chemother20004416601666

17 

Marguerite Fines Bruno Perichon Peter Reynolds Daniel F. Sahm Patrice Courvalin VanE, a New Type of Acquired Glycopeptide Resistance in Enterococcus faecalis BM4405Antimicrob Agents and Chemoth199943921612164

18 

T O’driscoll C W Crank Vancomycin-resistant enterococcal infections: epidemiology, clinical manifestations, and optimal managementInf Drug Resist20158217230

19 

Centers for Disease Control and Prevention Recommendations for preventing the spread of vancomycin resistance44Morb Mortal Wkly Rep1995RR12

20 

B E Murray B Mederski-Samoraj Transferable β lactamase: A new mechanism for in vitro penicillin resistance in Streptococcus faecalisJ Clin Invest19837211681171

21 

Francis P Tally Michael Zeckel Margaret M Wasilewski Claudio Carini Cindy L Berman George L Drusano Daptomycin: a novel agent for Gram-positive infectionsExpert Opinion on Investig Drugs19998812231238

22 

N E Allen W E Alborn J N Hobbs Inhibition of membrane potential-dependent amino acid transport by daptomycin.Antimicrob Agents Chemoth1991351226392642

23 

W E Alborn N E Allen D A Preston Daptomycin disrupts membrane potential in growing Staphylococcus aureus.Antimicrob Agents Chemoth1991351122822287

24 

24.National Committee for Clinical Laboratories Standards (NCCLS)MIC testing Supplemental tables. NCCLS document M100-S13(M7). National Committee For Clinical Laboratories StandardsWayne,Pa2003

25 

Alexandre Macedo Wolf-Rainer Abraham Can Infectious Biofilm be Controlled by Blocking Bacterial Communication?Med Chem200956517528

26 

T. Kelesidis R. Humphries D. Z. Uslan D. A. Pegues Daptomycin Nonsusceptible Enterococci: An Emerging Challenge for CliniciansClin Infecti Dis20115222282341058-4838, 1537-6591

27 

Nicholas S. Britt Emily M. Potter Nimish Patel Molly E. Steed Comparative Effectiveness and Safety of Standard-, Medium-, and High-Dose Daptomycin Strategies for the Treatment of Vancomycin-Resistant Enterococcal Bacteremia Among Veterans Affairs PatientsClin Infect Dis201764605613

28 

R. M. Humphries S. Pollett G. Sakoulas A Current Perspective on Daptomycin for the Clinical MicrobiologistClin Microbiol Rev2013264759780

29 

Mini Kamboj Nina Cohen Kathleen Gilhuley N. Esther Babady Susan K. Seo Kent A. Sepkowitz Emergence of Daptomycin-Resistant VRE: Experience of a Single InstitutionInfect Control Hospital Epidemiol201132439139410.1086/59152

30 

30.Clinical and Laboratory Standards Institute .Performance Standards for Antimicrobial Susceptibility Testing :Fifteenth Informational Supplement M100-S152005CLSI, Wayne, PA,USA

31 

H S Sader D J Farrell R K Flamm R N Jones Daptomycin activity tested against 164457 bacterial isolates from hospitalized patients: summary of 8 years of a Worldwide Surveillance ProgrammeInt J Antimicrob Agents20055465469

32 

T Judge J M Pogue D Marchaim Epidemiology of vancomycin resistant enterococci with reduced susceptibility to daptomycinInfect Control Hosp Epidemiol20121212501254

33 

B. J. Werth M. E. Steed C. E. Ireland T. T. Tran P. Nonejuie B. E. Murray Defining Daptomycin Resistance Prevention Exposures in Vancomycin-Resistant Enterococcus faecium and E. faecalisAntimicrob Agents Chemoth201458952535261

34 

C A Arias D Panesso D M Mcgrath X Qin M F Mojica C Miller Genetic basis for in vivo daptomycin resistance in EnterococciN Engl J Med201136510892900

35 

T T Trann D Panesso N N Mishra Daptomycin-resistant Enterococcus faecalis diverts the antibiotic molecule from the division septum and remodels cell membrane phospholipidsM Bio20134281313

36 

R Reik F C Tenover E Klein L C Mcdonald The burden of vancomycin Resistant enterococcal infections in US hospitalsDiagn Microbiol Infect Dis2003628185

37 

A I Hidron J R Edwards J Patel T C Horan D M Sievert D A Pollock S K Fridkin NHSN annual update: antimicrobial-resistant pathogens associated with healthcare-associated infections: annual summary of data reported to the National Healthcare Safety Network at the Centers for Disease Control and PreventionInfect Control Hosp Epidemiol2006299961011

38 

G G Zhanel N M Laing K A Nichol L P Palatnick A Noreddin T Hisanaga Antibiotic activity against urinary tract infection (UTI) isolates of vancomycin-resistant enterococci (VRE): results from the 2002 North American Vancomycin Resistant Enterococci Susceptibility Study (NAVRESS)J Antimicrob Agents Chemother200352382388

39 

Seema Mittal Pooja Singla Antariksha Deep Kiran Bala Rama Sikka Meenu Garg Vancomycin and High Level Aminoglycoside Resistance inEnterococcusspp. in a Tertiary Health Care Centre: A Therapeutic ConcernJ Pathog2016201615

40 

P Mathur A Kapil R Chandra P Sharma B Das Antimicrobial resistance in Enterococcus faecalis at a tertiary care centre of northern IndiaIndian J Med Res20031182528

41 

D M Sievert P Ricks J R Edward Antimicrobial -resistant pathogens associated with health care -associated infections: summary of data reported to the National Healthcare safety Network at the Centers for Disease Control and PreventionInfect Control Hosp Epidemiol20091114

42 

H S Sader R N Jones Antimicrobial susceptibility of Gram positive bacteria isolated from US medical centers: results of the Daptomycin Surveillance ProgramDiagn Microbiol Infect Dis200765158162

43 

Mini Kamboj Nina Cohen Kathleen Gilhuley N. Esther Babady Susan K. Seo Kent A. Sepkowitz Emergence of Daptomycin-Resistant VRE: Experience of a Single InstitutionInfect Control Hospital Epidemiol2011324391394

44 

H S Sader D J Farrell R N Jones Antimicrobial activity of daptomycin tested against gram-positive strains collected in European hospitals: results from 7 years of resistance sur­veillanceJ Chemother2003234200206

45 

G T Ertem B Ozturk C A Hatipoglu In vitro susceptibili­ties of Staphylococcus and E. species isolates to linezolid,daptomycin, teicoplanin and fusidic acidTurkiye Klinikleri J Med Sci20123313811387



jats-html.xsl


This is an Open Access (OA) journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.

  • Article highlights
  • Article tables
  • Article images

View Article

PDF File   Full Text Article


Copyright permission

Get article permission for commercial use

Downlaod

PDF File   XML File  


Digital Object Identifier (DOI)

Article DOI

https://doi.org/ 10.18231/j.ijmmtd.2020.010


Article Metrics






Article Access statistics

Viewed: 1435

PDF Downloaded: 565