Senior Data Engineering - PSM-Libra
CapcoJob Description
📋 Description Work on collecting, storing, processing, and analyzing large data sets Integrate data solutions with company architecture and power ML/analytics systems Collaborate with global teams to build core data services Lead and work with virtual teams to foster transparency and collaboration Apply distributed computing principles to design scalable data solutions 🎯 Requirements Strong knowledge of Big Data ecosystem (Hortonworks/Cloudera) Experience with Hive and Spark (PySpark); Scala and Python skills Experience with Hive, Spark, and data processing on large data sources CI/CD experience (Jenkins/Hudson/Ansible) and Agile (SCRUM) practices Familiarity with Python web frameworks (Flask/Tornado/Twisted) and basic frontend tech GCP experience (DataProc/Dataflow) and ELK stack knowledge