Job Duties:
Design and implement efficient large-scale data solutions in areas data ingestion, data curation, data quality, data visualization and data distribution using Ab Initio, Spark, Scala, Tableau and Business Objects. Manage and query data in data lakes and/or cloud data repositories in AWS. Responsible for writing well structured, testable PySpark code to implement use cases using Machine Learning techniques in a production grade environment. Design and develop UNIX shell scripts to automate the process of ETL. Write stored procedures, packages, functions, views in Oracle and MongoDB. Create test plans, test cases, test scripts and perform data testing and validation. Will work in Weddington, NC and/or various client sites throughout the U.S. Must be willing to travel and/or relocate.