Databricks Senior Solutions Architect _ GenAI focus
HiFlyLabsJob Description
📋 Description Lead end-to-end data pipelines and GenAI apps on Databricks (RAG, Text-to-SQL). Operationalize MLOps/LLMops: CI/CD, model serving, monitoring. Tune Spark jobs and LLM inference for efficiency and low latency. Advise clients on scalable data and GenAI architecture. 🎯 Requirements Spark Mastery: Apache Spark (Python/Scala) and Databricks Lakehouse. Performance Engineering: Tune queries, debug distributed systems, optimize for scale. Certification: Databricks Certified Data Engineer Professional (or equivalent). Applied GenAI: RAG pipelines, agentic workflows, tool-calling LLMs (LangChain/DSPy/HF). Model Lifecycle: Prompt engineering, fine-tuning, evaluation metrics. MLOps & LLMops: MLflow, model serving, deployment/monitoring of AI apps. Engineering Best Practices: CI/CD, unit testing for AI, IaC. 🎁 Benefits Diverse projects for growth Empowerment and autonomy Flexible ways of working Balanced life and healthy culture Mentoring from day one Learning and development opportunities