You are leaving our main website to go to our chinese website hosted in China. For legal reasons there will not be any links pointing back to the main website.

Go to chinese website
Logo - Keyrus
Logo - Keyrus
  • Playbook
  • Services
  • Insights
  • Partners
  • Careers
  • About us
    Company purpose
    Innovation & Technologies
    Committed Keyrus
    Regulatory compliance
    Investors
    Management team
    Brands
    Locations

Success story

Building a modern analytics platform for energy sector data

By Francesca Jimenez

Background  

Our client is a leading independent provider of information services and business intelligence in the energy industry. Their research reports and publications cover energy areas such as petroleum, natural gas, energy transition, and custom intelligence. 

Our client sought a new analytics platform to replace their old “black-box” system for mapping and calculating gas prices. 

Challenge

The company’s lack of a modern analytics platform was causing significant challenges. Much of their data analysis was performed ad hoc and manually via Excel.

Their previous system was a custom web development solution that required an expert for ongoing support, rather than allowing for analyst self-sufficiency. Their analysts, or editors, could not do work remotely due to the manual process with large Excel files that were slow and clunky.

Once the company published its insights and blended findings, it was a very difficult process to change them. Whenever an industry source reported a data update, the company had to invest a significant amount of time to completely redo analyses and data blending. Similarly, data mapping was a repeating task that was very time-consuming for their editors.

The company needed a new solution that would efficiently handle these edge cases promptly.

Our Solution

Keyrus designed an on-prem solution consisting of two platforms: Reference Data Admin (RDA) and Alteryx. 

Reference Data Admin (RDA)

RDA is the interface that company editors use to create, read, update, delete, and interact with the data. This module is inside quilliup, a data quality testing and governance platform. 

Alteryx

Alteryx is the ETL platform used to collect, transform, and move the data downstream, where our client can ultimately create the structured reports that they currently produce. The raw data is received from various sources in Excel format.

The process in Alteryx has a wrapper (or master workflow) and a source-specific macro for each source to handle all the loaded files. First, the Excel files from a directory are loaded. Then, a Python script is used to extract sheet names from the Excel files. To make the Alteryx process as dynamic as possible, these names are used to create an XML file for each source. These XML files are then used to run a separate, macro process for each source that handles different structures and creates a unified SQL table with all the data.  

In the following phase, an intermediate layer was constructed based on the published data of the previous phase. Published data is created when all of the data from the sources were extracted to the SQL tables and was signed off by the client. 

The intermediate layer supports the report creation feature on the company’s portal, rearranging the data to make it easier to create reports based on a single and simple query.

Results

This new solution allowed editors to change and validate calculated values based on trends and industry knowledge. With a few minor adjustments, editors are now able to add more sources with different structures. The SQL tables are the base for the RDA platform. This allows the editors to view and edit the data without any SQL knowledge needed.

Editors save tremendous amounts of time with the ability to perform updates to already published data. They can work faster, and if a mistake occurs, editors do not need to spend the entire night fixing it. 

A huge benefit of the system is quality improvements in organizing data, databasing full reported data, and analyzing data more comprehensively. Our solution provided the business with the following results:

  • Data updates after signoff or publication can be amended easily. Updates are being done to downstream system and reports as well

  • Data mapping is done in a more straightforward manner, which can also account for updates

  • The ability for analysts to work remotely. Editors only need internet access to complete work.

  • Business logic is maintained in one place

  • Data alerts are easy to track and update

Edge cases that used to take our client days to solve now take only minutes. More accurate price reporting can be done faster. Our main stakeholder stated that with the solution we built, there are no longer any edge cases that the company cannot be solved.

whatsapptwitter
linkedinfacebookworkplace
newsletter.svg

Never miss an insight

Stay updated on the latest articles, events, and more

Your email address is only used to send you the Keyrus newsletter and for commercial prospecting purposes. You can use the link in our emails to opt-out at any time. Learn more about the management of your data and your rights.

Continue reading

Press release

Keyrus named amongst Top B2B Companies on Clutch

December 12, 2022

The Keyrus team is excited to announce that we’ve been named one of the top 1000 companies on Clutch’s platform in 2022! This is the second year that Keyrus has been recognized by Clutch as a top company and B2B leader. 

Webinar

PDF Parsing with Alteryx Intelligence Suite

December 1, 2022

In 20 minutes, we’ll teach you how to use Alteryx Intelligence Suite to eliminate common problems and inefficiencies in accessing data from .pdf files. In the past, you’d need to run custom Python and complex parsing logic to get any usable data from a pdf. Now, you can parse PDFs with out-of-the-box features in Alteryx Intelligence Suite.

Webinar

Modern Cloud Analytics in Action: Keyrus and Red Ventures

November 11, 2022

The cloud offers new opportunities to save you time and money, allowing you to shift focus from maintaining growing servers and upgrading infrastructure to making your data work for you and the success of your business. Watch the webinar and Q&A to learn how AWS, Tableau, and Keyrus worked together to help Red Ventures migrate to a powerful cloud BI tool that created new pathways for success and a modern data culture.

Event

Pharma/Biotech GTN Summit 2022

October 27, 2022

Keyrus & Anaplan Sponsor Life Science Gross-to-Net (GTN) Summit

Press release

Keyrus Achieves AWS Data and Analytics Competency Status

October 6, 2022

Keyrus achieved Amazon Web Services (AWS) Data and Analytics Competency. To receive the designation, AWS Partners must possess deep AWS expertise and deliver solutions seamlessly on AWS.

Webinar

Live Webinar: Lessons on workforce capacity planning and optimization from Optum (UnitedHealthcare)

October 19, 2022

Wednesday, November 9th, 2022 @ 12:00PM Central Time (US and Canada)

Webinar

Tableau Embedded Analytics: Optimizing insights from Salesforce data

September 20, 2022

Want to optimize your visual analytics in Salesforce? You need the right tools. Tableau Embedded Analytics can be used to help you build and visualize reports in Salesforce.

Success story

How C&S Wholesale Grocers maximized ROI with an analytics center of excellence

September 7, 2022

C&S Wholesale Grocers worked with Keyrus and Alteryx to implement an analytics center of excellence to help them efficiently and effectively achieve business objectives, maximize return on investment (ROI), and standardize best practices.

Success story

Implementing a cloud security automation tool at a global consulting firm

September 2, 2022

Keyrus partnered with a consulting firm to build an in-house cloud security solution that would automate their verification processes and keep their information safe.

Success story

Leveraging Salesforce to improve operations at Pajama Program

July 25, 2022

Keyrus partnered with Pajama Program, a nonprofit organization, to review their Salesforce architecture and improve overall operations.

Logo - Keyrus
New York City

252 West 37th st., Suite 1400 New York, NY 10018

Phone:+1 646 664 4872

LinkedInInstagram
PlaybookServicesInsightsPartnersCareersAbout us
Company purposeInnovation & TechnologiesCommitted KeyrusRegulatory complianceInvestorsManagement teamBrandsLocations
Legal notice & Terms of use
Privacy policy
Data protection