Dmitri Apassov

math pro, BI specialist, aspiring data miner

[Dmitri Apassov @MadDataSc]

@MrSumfing Upon the actOR. acts are impersonal movements of events and curcumstances, contextualized by individual perception.

[Dmitri Apassov @MadDataSc]

@mattcasters @diethardsteiner @ApacheHop It's 9.1, and I am running test-job.kjb in data-integration/samples/transformations/job_executor/ with database logging turned on.
If you could point me in the direction of someone who could help.

[Dmitri Apassov @MadDataSc]

https://t.co/8rZzf6Yn3h @diethardsteiner @mattcasters #pentaho #pdi #kettle

[Dmitri Apassov @MadDataSc]

#pentaho #pdi question https://t.co/8rZzf6Yn3h

[Dmitri Apassov @MadDataSc]

#PDI #kettle #pentaho [rows with date] --> [job executor] does "execute job for each date"

[Dmitri Apassov @MadDataSc]

#PDI #kettle #pentaho If(like me) no javascript skills, use built-in #h2 database to generate rowsets with familiar constants like "today":
H2 conn- localhost/mem:db; port 8082
statement- SELECT FORMATDATETIME(TODAY,'yyyy-MM-dd')

[Pentaho @Pentaho]

Learn basic functions and capabilities of PDI while gaining insight into best practices for successful use in real world cases. https://t.co/9fqY4yzm6E #LearnHitachi

[Dmitri Apassov @MadDataSc]

@codek1 @Pentaho (1) put mssql-jdbc jar into data-integration\lib\ (2)put mssql-jdbc_auth-8.2.1.x64.dll into data-integration\libswt\win64\
(3)make conn as Native with pwd and user (4)Check “use integrated security” (5)for “options” add properties:authenticationScheme - NTLM; domainName - domain

[Dmitri Apassov @MadDataSc]

https://t.co/wuhakXqyH2 @codek1 @pentaho

[Dmitri Apassov @MadDataSc]

https://t.co/puUZvGwbrM

#howto #docker on #aws

[Dmitri Apassov @MadDataSc]

Is it crucial to run #carte or can we just spin up a #pdi container and #cron #kitchen runs from inside it? Log files to a #db somewhere

[Dmitri Apassov @MadDataSc]

local (dev) file repo in .kettle/repositories.xml, define one that you pull from bitbucket/github in #dockerfile

[Dmitri Apassov @MadDataSc]

1) create a bitbucket repo for ktr, properties and jndi.
2) locally always pull before exec
3) in #dockerfile add "make ktr repo", "pull from repo" and "replace stock config"
4) all relative paths

[Dmitri Apassov @MadDataSc]

Dev (locally) point jndi to dev redshift. In #dockerfile define JNDI to production db.

[Dmitri Apassov @MadDataSc]

Right, so aws credentials would go as env variables into https://t.co/pd6apkLr7u and redshift connection as JNDI.

[Dmitri Apassov @MadDataSc]

#Carte #dockerfile needs to include #aws #sdk installation and downloading and moving #redshift #jdbc driver to /lib

[Dmitri Apassov @MadDataSc]

Looking for #docker for #dummies #resources.

[Dmitri Apassov @MadDataSc]

new worklpace, new challenges. Learning #DOCKER, running #pentaho #pdi from it

[Dmitri Apassov @MadDataSc]

To make a #powerBI #filter act with #AND #logic check out this succint article: https://t.co/SMRP5A9qbj

[Dmitri Apassov @MadDataSc]

When number of attributes (staged as #JSON) is dynamic, model only business keys and their relationships (#HUBS n'#LINKS) in #datavault. Model whole JSON into "JSON"-sattelite. Extraction of concrete attribs is def by #reporting needs.