denodo SQL Type Mapping

denodo 7.0 saves some manual coding when building the ‘Base Views’ by performing some initial data type conversions from ANSI SQL type to denodo Virtual DataPort data types. So, where is a quick reference mapping to show to what the denodo Virtual DataPort Data Type mappings are:

ANSI SQL types To Virtual DataPort Data types Mapping

ANSI SQL TypeVirtual DataPort Type
BIT (n)blob
BIT VARYING (n)blob
BOOLboolean
BYTEAblob
CHAR (n)text
CHARACTER (n)text
CHARACTER VARYING (n)text
DATElocaldate
DECIMALdouble
DECIMAL (n)double
DECIMAL (n, m)double
DOUBLE PRECISIONdouble
FLOATfloat
FLOAT4float
FLOAT8double
INT2int
INT4int
INT8long
INTEGERint
NCHAR (n)text
NUMERICdouble
NUMERIC (n)double
NUMERIC (n, m)double
NVARCHAR (n)text
REALfloat
SMALLINTint
TEXTtext
TIMESTAMPtimestamp
TIMESTAMP WITH TIME ZONEtimestamptz
TIMESTAMPTZtimestamptz
TIMEtime
TIMETZtime
VARBITblob
VARCHARtext
VARCHAR ( MAX )text
VARCHAR (n)text

ANSI SQL Type Conversion Notes

  • The function CAST truncates the output when converting a value to a text, when these two conditions are met:
  1. You specify a SQL type with a length for the target data type. E.g. VARCHAR(20).
  2. And, this length is lower than the length of the input value.
  • When casting a boolean to an integertrue is mapped to 1 and false to 0.

Related References

denodo 7.0 Type Conversion Functions

Analytics Model Types

Every day, businesses are creating around 2.5 quintillion bytes of data, making it increasingly difficult to make sense and get valuable information from this data. And while this data can reveal a lot about customer bases, users, and market patterns and trends, if not tamed and analyzed, this data is just useless. Therefore, for organizations to realize the full value of this big data, it has to be processed. This way, businesses can pull powerful insights from this stockpile of bits.

And thanks to artificial intelligence and machine learning, we can now do away with mundane spreadsheets as a tool to process data. Through the various AI and ML-enabled data analytics models, we can now transform the vast volumes of data into actionable insights that businesses can use to scale operational goals, increase savings, drive efficiency and comply with industry-specific requirements.

We can broadly classify data analytics into three distinct models:

  • Descriptive
  • Predictive
  • Prescriptive

Let’s examine each of these analytics models and their applications.

Descriptive Analytics. A Look Into What happened?

How can an organization or an industry understand what happened in the past to make decisions for the future? Well, through descriptive analytics.

Descriptive analytics is the gateway to the past. It helps us gain insights into what has happened. Descriptive analytics allows organizations to look at historical data and gain actionable insights that can be used to make decisions for “the now” and the future, upon further analysis.

For many businesses, descriptive analytics is at the core of their everyday processes. It is the basis for setting goals. For instance, descriptive analytics can be used to set goals for better customer experience. By looking at the number of tickets raised in the past and their resolutions, businesses can use ticketing trends to plan for the future.

Some everyday applications of descriptive analytics include:

  • Reporting of new trends and disruptive market changes
  • Tabulation of social metrics such as the number of tweets, followers gained over some time, or Facebook likes garnered on a post.
  • Summarizing past events such as customer retention, regional sales, or marketing campaigns success.

To enhance their decision-making capabilities businesses have to reduce the data further to allow them to make better future predictions. That’s where predictive analytics comes in.

Predictive Analytics takes Descriptive Data One Step Further

Using both new and historical data sets predictive analytics to help businesses model and forecast what might happen in the future. Using various data mining and statistical algorithms, we can leverage the power of AI and machine learning to analyze currently available data and model it to make predictions about future behaviors, trends, risks, and opportunities. The goal is to go beyond the data surface of “what has happened and why it has happened” and identify what will happen.

Predictive data analytics allows organizations to be prepared and become more proactive, and therefore make decisions based on data and not assumptions. It is a robust model that is being used by businesses to increase their competitiveness and protect their bottom line.

The predictive analytics process is a step-by-step process that requires analysts to:

  • Define project deliverables and business objectives
  • Collect historical and new transactional data
  • Analyze the data to identify useful information. This analysis can be through inspection, data cleaning, data transformation, and data modeling.
  • Use various statistical models to test and validate the assumptions.
  • Create accurate predictive models about the future.
  • Deploy the data to guide your day-to-data actions and decision-making processes.
  • Manage and monitor the model performance to ensure that you’re getting the expected results.

Instances Where Predictive Analytics Can be Used

  • Propel marketing campaigns and reach customer service objectives.
  • Improve operations by forecasting inventory and managing resources optimally.
  • Fraud detection such as false insurance claims or inaccurate credit applications
  • Risk management and assessment
  • Determine the best direct marketing strategies and identify the most appropriate channels.
  • Help in underwriting by predicting the chances of bankruptcy, default, or illness.
  • Health care: Use predictive analytics to determine health-related risk and make informed clinical support decisions.

Prescriptive Analytics: Developing Actionable Insights from Descriptive Data

Prescriptive analytics helps us to find the best course of action for a given situation. By studying interactions between the past, the present, and the possible future scenarios, prescriptive analytics can provide businesses with the decision-making power to take advantage of future opportunities while minimizing risks.

Using Artificial Intelligence (AI) and Machine Learning (ML), we can use prescriptive analytics to automatically process new data sets as they are available and provide the most viable decision options in a manner beyond any human capabilities.

When effectively used, it can help businesses avoid the immediate uncertainties resulting from changing conditions by providing them with fact-based best and worst-case scenarios. It can help organizations limit their risks, prevent fraud, fast-track business goals, increase operational efficiencies, and create more loyal customers.

Bringing It All Together

As you can see, different big data analytics models can help you add more sense to raw, complex data by leveraging AI and machine learning. When effectively done, descriptive, predictive, and prescriptive analytics can help businesses realize better efficiencies, allocate resources more wisely, and deliver superior customer success most cost-effectively. But ideally, if you wish to gain meaningful insights from predictive or even prescriptive analytics, you must start with descriptive analytics and then build up from there.

Which Version Control Systems Are supported by denodo Virtualization 7.0?

Using Version Control is a denodo Virtual DataPort (VDP) recommended best practice. Version 7.0 of denodo virtualization supports three Version Control Systems (VCS):

  • Microsoft Team Foundation Server (TFS) 2010 or later
  • Apache Subversion (1.7), and
  • Git

Related References:

Denodo Data Virtualization Project Roles

A Denodo virtualization project typically classifies the project duties of the primary implementation team into four Primary roles.

Denodo Data Virtualization Project Roles

  • Data Virtualization Architect
  • Denodo Platform Administrator
  • Data Virtualization Developer
  • Denodo Platform Java Programmer
  • Data Virtualization Internal Support Team

Role To Project Team Member Alignment

While the denodo project is grouped into security permissions and a set of duties, it is import to note that the assignment of the roles can be very dynamic as to their assignment among project team members.  Which team member who performs a given role can change the lifecycle of a denodo project.  One team member may hold more than one role at any given time or acquire or lose roles based on the needs of the project.

Denodo virtualization Project Roles Duties

Data Virtualization Architect

The knowledge, responsibilities, and duties of a denodo data virtualization architect, include:

  • A Deep understanding of denodo security features and data governance
  • Define and document5 best practices for users, roles, and security permissions.
  • Have a strong understanding of enterprise data/information assets
  • Defines data virtualization architecture and deployments
  • Guides the definition and documentation of the virtual data model, including, delivery modes, data sources, data combination, and transformations

Denodo Platform Administrator

The knowledge, responsibilities, and duties of a Denodo Platform Administrator, Include:

  • Denodo Platform Installation and maintenance, such as,
    • Installs denodo platform servers
    • Defines denodo platform update and upgrade policies
    • Creates, edits, and removes environments, clusters, and servs
    • Manages denodo licenses
    • Defines denodo platform backup policies
    • Defines procedures for artifact promotion between environments
  • Denodo platform configuration and management, such as,
    • Configures denodo platform server ports
    • Platform memory configuration and Java Virtual Machine (VM) options
    • Set the maximum number of concurrent requests
    • Set up database configuration
      • Specific cache server
      • Authentication configuration for users connecting to denodo platform (e.g., LDAP)
      • Secures (SSL) communications connections of denodo components
      • Provides connectivity credentials details for clients tools/applications (JDBC, ODBC,,,etc.)
      • Configuration of resources.
    • Setup Version Control System (VCS) configuration for denodo
    • Creates new Virtual Databases
    • Create Users, roles, and assigns privileges/roles.
    • Execute diagnostics and monitoring operations, analyzes logs and identifies potentials issues
    • Manages load balances variables

Data Virtualization Developer

The Data Virtualization Developer role is divided into the following sub-roles:

  • Data Engineer
  • Business Developer
  • Application Developer

the knowledge, responsibilities, and duties of a Denodo Data Virtualization Developer, by sub-role, Include:

Data Engineer

The denodo data engineer’s duties include:

  • Implements the virtual data model construction view by
    • Importing data sources and creating base views, and
    • Creating derived views applying combinations and transformations to the datasets
  • Writes documentation, defines testing to eliminate development errors before code promotion to other environments

Business Developer

The denodo business developer’s duties include:

  • Creates business vies for a specific business area from derived and/or interface views
  • Implements data services delivery
  • Writes documentation

Application Developer

The denodo application developer’s duties include:

  • Creates reporting vies from business views for reports and or datasets frequently consumed by users
  • Writes documentation

Denodo Platform Java Programmer

The Denodo Platform Java Programmer role is an optional, specialized, role, which:

  • Creates custom denodo components, such as data sources, stored procedures, and VDP/iTPilot functions.
  • Implements custom filters in data routines
  • Tests and debugs any custom components using Denodo4e

Data Virtualization Internal Support Team

The denodo data virtualization internal support team’s duties include

  • Access to and knowledge of the use and trouble of developed solutions
  • Tools and procedures to manage and support project users and developers

Denodo Virtual Dataport (VDP) naming Convention Guidance

Denodo provides some general Virtual Dataport naming convention recommendations and guidance.  First, there is the general guidance for basic Virtual Dataport object types and, secondly, more detail naming guidance recommends.      

Denodo Basic Virtual Dataport (VDP) Object Prefix Recommendations

  • Associations Prefix: a_{name}
  • Base Views Prefix: bv_{name}
  • Data Sources Prefix: ds_{name}
  • Integration View Prefix: iv_{name}
  • JMS Listeners Prefix: jms_{name}
  • Interfaces Prefix: i_{name}
  • Web Service Prefix: ws_{name}

Virtual Dataport (VDP) High-Level Project Structure

Different layers are identified when creating logical folders hierarchies within each Data Virtualization project.  The recommended high-Level project folders are:

Connectivity

  • Connectivity, where related physical systems, data sources, and base views are part of this folder.

Integration

  • Integration views include the combinations and transformations views for the next layers. Not directly consumed views at this level.

Business Entities

  • Business Entities include Canonical business entities exposed to all users.

Report Views

  • Report Views include Pre-built reports and analysis frequently consumed by users.

Data Services

  • Data Services include web services for publishing views from other levels. Can contain views need for data formatting and manipulation.

Associations

  • This folder stores associations.

JMS listeners

  • This folder stores JMS listeners

Stored procedures

  • This folder stores custom stored procedures developed using the VDP API.

Denodo Knowledge Base VDP Naming Conventions

Additional more detailed naming convention and Virtual Dataport organization guidance are available in the donodo Community Knowledge Base, under Operations

Knowledge Base Virtual Dataport (VDP) Naming Conventions Online Page

Virtual Dataport (VDP) Naming Conventions Downloadable PDF

Are Information Technology Skill Badges Valuable?

Information Technology (IT) Skill badges are becoming more prevalent in the information technology industry, but do they add value?  I will be in the past I have only bothered with certifications where my clients or my employer thought they were valuable.  At some point in your career experience should mean more tests and training.  So, perhaps is time to consider the potential value of IT Skills badges (Mini-certification) and the merits behind them.

What Are Information Technology (IT) Skills Badge?

IT Skills badges are recognized as mini-certification, which are portable. IT Skills badges are achieved when an individual completes a project, completes a course, or make a distinguished contribution towards code repository on either GitHub or elsewhere. When a person earns this kind of certification, the IT Skills badges can be stored in a digital wallet. An individual can use it by either including it to his/her LinkedIn profile or website. The issuer has the authority of editing the badges. This feature is designed to bolster credibility.

Research shows that many IT job applicants show badges as an added advantage in his/her skills. IT skills badge are not a sure bet in job hunting that an applicant will land on that particular job because most job recruiters don’t focus on them.

Many IT industries want validated skills before hiring an applicant. IT Skills badges are complementary to certificates, but IT Skills badges can’t in any way replace certifications. Individuals with convectional certifications have high chances of landing on premium pay. As a result, badges don’t ensure the owner a pay boot in his/her job.

How Do IT Skills Badges Differ From A Certification?

Certifications are considered evidence by many of an individual’s skills. Does this mean that any other credential systems aren’t necessary for proving your skills? IBM’s study shows that technology is growing at a faster rate in areas like artificial intelligence, big data, and machine learning and the updating and creation of certifications can lag because of the time required to update or developing certifications is lengthy.

Another difference when it comes to comparison between IT Skill Badges and certification is that certifications are seen to be more expensive to both employers and employees. It is costly to achieve certification, and a lot of study time and books may be required. An in-depth done survey shows that employers are willing to pay a good portion to the right certification. Certificate value is drastically increasing value yearly as compared to badges.

Clients of IT companies consider engaging in a contract with the company after making sure that the company has a specific number of employees with specified certifications. IT Skills badges are at a disadvantage for hiring consideration. Most hiring managers, the likes of Raxter Company, don’t know the benefit of badges or even what IT Skills badges can do with IT Skills badges. IT Skills badges are new in the market; hence, most employers have little information about IT Skills badges. For instance, an applicant who in the past years has worked for IBM Company presents an IBM badge to Raxter interview panel, and the panel will not know what it means.

In the case of Grexo Technology Group’s CEO, Bobby Yates, IT services Company in Texas doesn’t know the apparent value of IT skills badge. He further challenges it by saying that most applicants have presented the badges to him. But he surely doesn’t know the importance of them towards his requirements from the applicants. He further says that he doesn’t consider badges as a valuable hiring tool as compared to certification.

Dupray’s Tremblay, on the other hand, seconds the elimination of badges as an essential tool for hiring by saying that he will not know if the applicant is cheating to him. As a result, he values the certification as a real prove of skills towards IT.

How To Obtain IT Skills Badges

Most Companies’ hiring panels consider IT Skills badges as nothing towards job requirements. But some companies’ managers like O’Farril and others challenge them by finding them worthy when it comes to IT workers investment. CompTIA’s Stanger, on the other hand, backs badges by referring to them as a complement to a basket of certifications, good resumes, and real-world towards job experience. He adds by saying that it is a form of strengthening the education chain. Raxter on his personality considers IT Skills badges as a selling point. As a result, IT Skills badges are essential to present to some recruiters.

The following are the top five tips that will aid an individual towards his carrier advancement in getting the most in IT skills badges.

1. Avoid listing badges which are easily obtained. Anything that can take less than 40 hours to complete it is unworthy of mentioning it in your professional resume.

2. Always consider those courses that directly aline with the type of jobs for which you are applying. IT skills badges that directly complements to your job requirements are worth taking. Irrelevant badges may, to an extent, reduce the chances of being recruited.

3. Make sure to pair the badges attained with your education or real working experience.

4. Don’t insist on the importance behind your badges. Not everybody will like to hear. Real work experience always takes the lead.

5. If you can’t defend your knowledge, experience, and skills or hiring managers will consider unqualified. ITSkill badges and certifications show that you had enough knowledge to pass the qualifications, but employees want people who can and will excel at doing the work as part of a team. requirements

Do IT Skills badges have value in the hiring process?

IT skills complement IT certification and act as an added advantage in hiring panel, mostly when your certification is almost similar to the other candidates. IT Skills badges add some value towards a good resume, real job experience, and certifications. Some recruiters consider IT Skills badges worthy when it comes to the hiring process. Recruiters think them as a selling point.

So it’s essential to take IT Skills badges that relate to your job application to spice your application form. Remember to keep in mind the top five tips when you decide to have one. In other words, IT Skills badges are somehow worthwhile to consider in IT workers investments.

IT skills badge from a social media perspective

Social Media badges are virtual validator of successful completion of a task, skill, or educational objective. IT Skills badges can either be physical or digital depending upon what other people in a particular community value or market. IT Skills badges are more prevalent in a collaborative environment, and social media as well as portals and learning platforms, including team participation, certification, degrees, and project accomplishments.

In conclusion, many IT skills are available for your earnings. To gain more on IT Skills badges, you can visit IBM, Pearson VUE, a global learning company, and others who have partnered in offering IT Skills badges. You will be able to find a range of IT Skills badges from which to choose.

denodo Virtualization – Useful Links

Here are some denodo Virtualization references, which may be useful.

Reference Name Link
denodo Home Page https://www.denodo.com/en/about-us/our-company
denodo Platform 7.0 Documentation https://community.denodo.com/docs/html/browse/7.0/
denodo Knowledge Base and Best Practices https://community.denodo.com/kb/
denodo Tutorials https://community.denodo.com/tutorials/
denodo Express 7.0 Download https://community.denodo.com/express/download
Denodo Virtual Data Port (VDP) https://community.denodo.com/kb/download/pdf/VDP%20Naming%20Conventions?category=Operation
JDBC / ODBC drivers for Denodo https://community.denodo.com/drivers/
Denodo Governance Bridge – User Manual https://community.denodo.com/docs/html/document/denodoconnects/7.0/Denodo%20Governance%20Bridge%20-%20User%20Manual

Related References