Job Description
• Gather business requirement and user stories
• Create and implement solutions based on the business problems, requirements and needs
• Provide advisory and consultation on data engineering while liaison among stakeholders to drive implementation success
• Design and implement databases infrastructure solutions to meet usability and performance needs
• Support Data Engineers through the execution of their work
• Design and evaluate data models, review and improve functional data models created by Data Engineers, Juniors, and interns
• Apply ETL/ETL (extract, transform, load) best practices for data pipeline with SQL and other tools
• Encourage and implement coding, ETL and other technical best practices into the team’s execution of work
• Monitor data quality to ensure consistency, integrity and availability of data
• Control data row-level security access
• Implement Data Governance as well as write and maintain documentation for data governance
Job Requirement
• Bachelor degree or higher in relevant subjects such as software engineering, data engineering, computer science, statistics, economics, finance, mathematics or related fields
• Minimum 3+ years of experience – A plus in finance/banking/Insurance sector or consulting company
• Experience with programming languages: SQL, T-SQL, Python
• Experience with big data tools like Hadoop, Spark, and Hive will be highly desirable
• Experience with data analytics and visualization tools like MS Power BI, Google Data Studio, Tableau, Grafana, Apache Superset, etc.
• Familiarity with ETL and data warehousing tools such as Talend, Airflow, SSIS, Informatica
• Familiarity with common database systems
o Relational Databases (RDMS): Postgres, MySQL, Oracle, MS SQL Server
o Cloud computing and database: Redshift, Azure SQL Database, Amazon S3, etc.
o NoSQL Databases: MongoDB, Cassandra, HBase
o Big Data: Hadoop, Spark, MapReduce, Hive, and Pig, and other Big Data Stacks
o Graph Database: Neo4j, Amazon Neptune, Redis, etc.
o Strong desire to establish standards of best practice, automation workflow and framework
o Soft and interpersonal skills:
o Great communication skills; able to present results to non-technical audience
o Excellent leadership and mentoring skills
o Attention to detail. Be a detective to identify and fix database problems and data quality
o Creativity in solving problems; think inside and outside the box to connect dots
o Positive and can-do attitude yet humble; get excited about learnings and challenging work
o Ability to abstract general principles from specifics