Member of Technical Staff | Knowledge Platform
Avra- Employee
Job Description
📋 Description
- Build and run the acquisition layer: crawlers, scrapers and browser RPA that collect data from
- Keep collection reliable as sources change: detect layout and access changes early, track coverage
- Run event-driven ingestion on Kafka and Pub/Sub, including ordering, replays, dead-letter queues
- Build batch and incremental pipelines in Spark, dbt and SQL that turn raw captures…
pythonsqlkubernetesjavascriptsparkdatakafkadbtpub/sub
Match
Sign in and add your skills to see how well you match this role.
Tailor your CV to this jobPro
Pro rewrites your CV bullets for this job and checks every line against your CV, dropping anything it can't back up.
See ProBack to all jobs