bitrix (11) 1C (10) vTiger (9) JS (7) Bitrix24 (7) php (6) ERP (5) Asterisk (4) CRM (4) WMS (4) moodle (4) WordPress (3) BigData (3) simplaCMS (3) GoLang (2) magento (2) optimization (2) shopify (2) joomla (2) WebAssyst (2) ↵ Show all
GoLang multithread data parsing crawler for millions of sites. Processing.

Spider for parsing legal entities info ( contacts, addresses, links, etc ) from millions of arbitrary organizations websites. Batch processing. The ability to run from different os systems. Failed requests repeat system.
#GoLang #parsing #BigData
Online-Base of russian legal entities
e-kc.ru - Electrical products wholesale supply, b2b-bases

Participation in the development of russian most complete base of electrical products.

Suppliers, catalogs data aggregation. Morphological trigram based search based on Sphinx ( Manticore )
#Sphinx #Manticore #BigData
Large base of electrical goods in Russia
e-kc.ru - Electrical products wholesale supply, b2b-bases

Similar sites сalculation based on search engines results with RUST.

Processing a giant sites intersections array, which requires hundreds gigabytes of RAM without optimizations and smart data sorting with heuristics. Succeeded to calculate on one PC in a couple of days for all Runet sites ( yandex, google SERP ).
#RUST #BigData
Online-Base of russian legal entities
e-kc.ru - Electrical products wholesale supply, b2b-bases