关于datastage的各种stage

deltime

我这有一领导的想法是，
把人员从数据库里剥离出来。
不需要DS的人员对数据知识有很深入的了解，
甚至不允许DS的人员利用其它工具来连接数据，
以确保数据库的安全，以方便工作的交接。

johnsoncgq

IBM GTS CIO部门招聘
BU Description
IBM CDL DIAS (Data Integration & Analytics Services) team is a rapid growing-up team in GTS Development Lab. This team is supporting IBM CIO value chain applications which created significant contribution to IBM business. Currently this team focuses on the design and implementation of IBM internal Operational Data Store, Data Warehouse/Data Mart, Decision Support System, Customer Support Data Warehouse and provides the full life-cycle BI solutions (from Data to Application) for IBM CIO office. In this team, you will have great opportunities of working with senior Data Warehouse & Business Intelligence professionals and plenty of chances of learning leading edge DW & BI technologies. Most importantly, you can have the valuable opportunities to adopt the advanced BA (Business Analytics) concepts & technologies to make IBM more smarter. Don't hesitate to join us.

Job Description / Responsibilities
CDM (Customer Data Matching)

CDM project focuses on the integration of the customer and contact data from those acquired companies.  It is one of key steps for the smooth progress of IBM acquisition strategy.

We are looking for great talents who will be responsible for:
- Develop ETL related projects based on DataStage and Qualitystage Priority 1
- Develop BI related projects based on Cognos.
- Contribute to project design & specification documents, participate in design reviews.
- Compose proper development & test plans to ensure the high quality.
- Closely work with worldwide architects and tech leads.
Job Requirements (skills/experiences)
Skills requirement

- Good knowledge of Data Warehouse & Business Intelligence knowledge and project experiences
- Strong skill of business requirement analysis and technical solution design
- Good knowledge of Database systems and SQL programming
- Unix/Linux Knowledge and script programming
- Familiar with DataStage & Cognos
- Good knowledge of Java, J2EE, XML, Web Services, etc
- Strong analytical and troubleshooting skills

Personal Qualities
- Strong communication skill
- Good teamwork spirit
- Open minded
- Self-motivated and strong leadership
- Quick learner
- Creative thinking
- Strong sense of ownership and high accountability
- Good communication & documentation skills in English

Qualifications (Education/Major/Certificates)
Bachelor or Master in Computer Science or related disciplines
Having DB2 or Congos certificates will be highly expected

Please send your CV to chenggq@cn.ibm.com

ml870914

看看。。。。

dap570

当你面临 物理上分开的 异构的 不同的DBMS 一堆的库,一堆的source table,上亿的数据..

这时你就会开始头疼了.

hock57

大型的数据仓库的数据库在做ETL过程中大多仅是用来取数和装数用的，大量的join和复杂的逻辑运算一般都给datastgae去做，datastage有很好的并行特性。换句话说把数据库当作一个黑盒，只对它作取数和装数操作，ETL过程全交给ETL工具去做。
另外比如说有一个复杂的需要运行几个小时的SQL或存储过程在交给数据库运行，在运行的过程中，你不知道它进行到什么程度了，不知道已经跑死了还是正在跑。如果你将这段sql或存储过程设计成job，这是job在运行时，你可以清的看到进行到哪里，是正在抽数，还是正在做join，还是正在做aggregate，哪块数据做join后重复了，一目了然。

IT_defang

观望。。。。。。。。。

cognizanthunter

我是来学习的。

zhulijia2009

stage可以二次开发，可以把那些函数包含进来。

你以为的就是你以为

我也在想这个问题