Senior Data Engineer
Who You Are
This is a senior management role that paid 100% in equity until we are funded. (Remote).
As an Intelligence Data Engineer - Senior Role, you will be responsible for maintaining and growing our data analytics stack. They should have deep experience collecting data from external sources via APIs and other methods.
Ideal candidates for this role should be ambitious and excited by the challenge of building a cutting-edge data stack focused on bleeding edge data in a rapidly evolving, frontier industry. A high degree of curiosity and a genuine interest in exploring and pushing the boundaries is required to succeed in this role.
Overall, this will be an exciting challenge for the right candidate.
Web Data Scraping, Visualization, and Data ETL (Extract, Transform, Load).
Knowledge of web scrapers by using Python, Selenium, Scrapy, BS4, and Requests.
Knowledge of various types of documents such as CSV, JSON, XML, Excel.
Generate clean and accurate data.
Maintain the existing data stack by monitoring pipeline alerts and fixing jobs as needed
Integrate new data sources into the data stack.
Upgrade existing data infrastructure to provide for continued scalability and reliability.
Strong desire to pursue broadening and deepening technical knowledge.
At least two years of relevant work experience, building data pipelines and maintaining databases.
Experience with REST APIs and web scraping.
Meaningful experience with both SQL, NoSQL.
Attention to detail is a must, as the data sets are essential for significant business decisions.
Self-starter needing limited oversight and input, take extreme ownership of problems and stick with them to completion.
Able to juggle a handful of responsibilities simultaneously with flexibility.
Experience building ETL pipelines and maintaining large data sets from different sources.
Experience working in a fast-paced environment.
Experience pioneering new methods, architectures, and processes to solve problems with limited guidance.