Databricks Architect Job at Akaasa Technologies, Arlington, VA

TGw3VVZOMGEwMXp5TjlvZU9nOTFZaHV1N3c9PQ==
  • Akaasa Technologies
  • Arlington, VA

Job Description

Databricks Architect

Hybrid Onsite in Arlington, VA

Key Responsibilities

  • Lead the identification and categorization of existing Hadoop workloads (ETL, batch, streaming) and data sources for migration to Databricks.
  • Design and implement scalable, repeatable migration use cases, focusing on MVP (Minimum Viable Product) approaches to accelerate value delivery.
  • Provision and architect Databricks environments, including sandbox workspaces with Lakehouse architecture and federation capabilities.
  • Enable seamless connectivity to external data sources (e.g., Hive) and oversee pilot migrations using tools such as Databricks Migration Accelerator or third-party partner solutions.
  • Validate migrated workloads for performance, cost efficiency, and data integrity, leveraging features like Z-ordering, Liquid Clustering, Lakehouse AI monitoring, and Serverless warehouse capabilities.
  • Monitor query performance, storage efficiency, and pipeline health using advanced Databricks features and best practices.
  • Collaborate cross-functionally with data engineering, analytics, and governance teams to validate outcomes and incorporate feedback.
  • Document learnings, blockers, and feature gaps to inform broader rollout and continuous improvement efforts.
  • Define and track success metrics such as migration time, query latency, cost savings, and feature adoption.
  • Develop a phased roadmap for full-scale migration, advanced feature adoption, and future platform optimizations.

Qualifications

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.
  • 10+ years of experience in data architecture, with significant hands-on experience in Hadoop and Databricks environments.
  • Proven expertise in cloud data platforms (Azure), data engineering, and ETL processes.
  • Strong understanding of Lakehouse architecture, data federation, and modern data governance frameworks (e.g., Unity Catalog).
  • Experience leading large-scale migration projects, including MVP definition and iterative delivery.
  • Advanced proficiency with Databricks features such as Delta Lake, Liquid Clustering, AI monitoring, and serverless compute.
  • Excellent communication, leadership, and stakeholder management skills.
  • Ability to mentor and guide cross-functional teams in adopting best practices and innovative data solutions.

Preferred Skills

  • Experience with Databricks Migration Accelerator or similar migration tools.
  • Hands-on expertise in testing advanced features (dynamic clustering, Lakehouse Federation, Unity Catalog).
  • Knowledge of data security, access controls, and compliance in cloud environments.
  • Experience generating synthetic data and ensuring data governance in migration scenarios.

Job Tags

Similar Jobs

College Hunks Hauling Junk & Moving

🚀 Sales Development Representative (SDR) Job at College Hunks Hauling Junk & Moving

Are you a confident communicator who thrives on helping others and closing deals? Do you want a role where your hustle is rewarded, your work has purpose, and your future is bright? Join our top-performing inside sales team at College HUNKS Hauling Junk & Moving , where...

Houston Methodist

Research Technician I - Cancer - Andrew Hu Job at Houston Methodist

An entry level Research Technician position is available in the laboratory of Drs. Chih-Chi Andrew Hu and Chih-hang Anthony Tang with a focus on Immune Cell Biology, Biochemistry, Molecular Biology and Drug Discovery. The successful candidate will conduct independent laboratory...

Affinity Network of District Partner Schools

Senior Research Analyst Job at Affinity Network of District Partner Schools

 ...scalable approaches to achieving equitable outcomes for students in public schools across New York City and beyond. Our data and research work supports this mission by providing staff with actionable, timely, and accessible information to make data-informed decisions.... 

Gravity Research

Social Impact and Reputational Risk Analyst Job at Gravity Research

 ...Gravity Research is hiring a Social Impact and Reputational Risk Analyst . Gravity Research, born of National Journal, is a premier custom research and insights organization supporting corporate, association, and nonprofit clients. Our mission is to empower organizations... 

Andritz

Warehouse Manager Job at Andritz

 ...the success of our clients in key industries that are shaping the future of the world we live in. Brief Description The Warehouse Manager is responsible for overseeing all warehouse operations, ensuring efficient receipt, storage, handling, and dispatch of products...