Выбранные столбцы без дубликатов с использованием vbs

Question

Это действительно оценено, если бы кто-то помог мне в этом, используя скрипт vbs. У меня есть текстовый файл с 4 ГБ (данными ниже данных образца - в конце концов, это), и мне нужно только эти трех колонок данных из моих присоединенных текстового файла

"20150901162037","20150901162037","LDAP_Prod/xyrep, tett" 

без дублирования данных, так как у меня есть многие из них Аналогичные идентификаторы ldap есть. , поэтому мне нужно брать только с уникальными идентификаторами с тремя столбцами. Пожалуйста, вы можете помочь мне, как добиться использования скрипта vbs. Наконец мне нужен мой вывод будет следующий путь с вне dulicates:

"20150901162037","20150901162037","LDAP_Prod/xyrep, tett" 
"20150901162037","20150901162037","LDAP_Prod/ttin_tess" 
. 
… 

мой пример данных здесь:

"100aEB","20150901162037","20150901162037","LDAP_Prod/xyrep, tett","N","11937.91666666667","0","Test_Plan","360610","BAU","Version1","Budget","LDDRR","31029","21240","36542_31029","2016","Jan","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ xyrep, tett ","N","11937.91666666667","0","SS_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Feb","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ttin_tess","N","11937.91666666667","0","LLL_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Aug","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ xyrep, tett ","N","11937.91666666667","0","SS_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Feb","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ttin_tess","N","11937.91666666667","0","LLL_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Aug","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ttin_tess","N","11937.91666666667","0","LLL_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Aug","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ttenetess","N","11937.91666666667","0","LLL_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Aug","6050210000","" 

"100aEB","20150901162037","20150901162037","LDAP_Prod/ttin_tess","N","11937.91666666667","0","LLL_Plan","360610","BAU","Version1","Budget","LDGR","31029","21240","36542_31029","2016","Aug","6050210000","" 

Answer 1

Опишите свой входной файл, используя schema.ini файл:

[33851749.txt] 
Format=CSVDelimited 
ColNameHeader=False 
DecimalSymbol=. 
Col1=AA Text 
Col2=BB Text 
Col3=CC Text 
Col4=DD Text 

(минималистичный/нужно знать версию, чтобы заставить ее работать, вы наверняка сможете сделать лучше)

ADODB Connection Откройте для вашего входного файла, выберите distinct'ly ваши 3 колонки», и написать записи цитируемые в STDOUT (или файл):

Option Explicit 

Const adClipString = 2 

Dim oFS : Set oFS = CreateObject("Scripting.FileSystemObject") 
Dim oDB : Set oDB = CreateObject("ADODB.Connection") 
Dim sCS : sCS  = Join(Array(_ 
    "Provider=Microsoft.Jet.OLEDB.4.0" _ 
    , "Data Source=" & oFS.GetAbsolutePathName("..\data") _ 
    , "Extended Properties=""text""" _ 
), ";") 
oDB.Open sCS 
Dim sSQL : sSQL = "Select Distinct BB, CC, DD from [33851749.txt]" 
Dim oRS : Set oRS = oDb.Execute(sSQL) 
Do Until oRS.EOF 
    WScript.Echo """" & oRS.GetString(adClipString, 1, """,""", """", """""") 
Loop 

oDB.Close 

Это должно дать вам:

cscript 33851749.vbs 
"20150901162037","20150901162037","LDAP_Prod/ xyrep, tett" 
"20150901162037","20150901162037","LDAP_Prod/ttenetess" 
"20150901162037","20150901162037","LDAP_Prod/ttin_tess" 
"20150901162037","20150901162037","LDAP_Prod/xyrep, tett"