1 / 106

Workplace System Test, Build & Performance Status/Biweekly Report December 13, 2007

Workplace System Test, Build & Performance Status/Biweekly Report December 13, 2007. Build Summary for Notes/Domino & Extended Products pls update. Build Summary for Notes/Domino Extended Products and Unyte pls update. Build Summary for Expeditor, Mobile Connect, Notes Traveler, WECM & WEA.

dorij
Télécharger la présentation

Workplace System Test, Build & Performance Status/Biweekly Report December 13, 2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Workplace System Test, Build & PerformanceStatus/Biweekly ReportDecember 13, 2007

  2. Build Summary for Notes/Domino & Extended Products pls update

  3. Build Summary for Notes/Domino Extended Products and Unyte pls update

  4. Build Summary for Expeditor, Mobile Connect, Notes Traveler, WECM & WEA

  5. Build Summary for Portal/WCM, Quickr, Designer, Learning, Business Solutions

  6. Summary of Products Built by Other Areas pls update

  7. Highlights and Challenges: Build & Config-Mgmt Support pls update

  8. Interoperability Solutions Test Team pls update

  9. Interoperability Solutions Test Team (cont’d) pls update

  10. Lotus Quickr 8.0.0.1 – (Early Program) pls update Accomplishments • Quickr/Domino R8.0.0.2 shipping • Quickr/J2EE delayed • Seagate installed R8.0.2/Domino this week • Waiting for SNAPPS templates to be updated • Seagate delivered a list of 26 UI enhancements – many will be addressed in next release • “Versioning” support (Tech. Preview only) • Selected customers will be provided an access key to gain access to this feature. Quickr/Domino R8.0.0.2 Shipped Quickr/J2EE Chubu Electric Power Saint-Gobain Seagate Standard Insurance Quickr/Domino Colgate Palmolive Sandvik Schneider Electric Singapore IDA (unknown) Travelers Insurance Union Pacific Rail Quickr/J2EE & Domino 3M Bayer McKinsey Nokia PriceWaterhouse Coopers (pwc) Issues reported SNAPP templates must be updated to support R8.0.0.2/Domino SNAPPS responding to customer issues reported via public forum.

  11. Domino Quickr Post 8.0.0.2 eGA Activity pls update • Quickr domino 8.0.0.2 is now closed with completion of Hot fix 1. • Driving other test gaps to be fixed in Quickr 8.1 • Memory Leak reduction will be tackled in the 8.1

  12. Quickr Domino Reliability Long Runs 8.0 vs 8.0.0.2 pls update

  13. J2EE Quickr 8.0.0.2 Status pls update

  14. Quickr J2EE Reliability run current status pls update

  15. Quickr J2EE Reliability History Long Runs pls update

  16. Quickr 8.1 SVT Status pls update • Overall status: Yellow Yellow • Accomplishments: • Operational profiles and data population goals are defined for 8.1 • IVT started this week for Domino and J2EE • Finalizing Test Scenarios for new function/features • Combined all SVT Quickr Test Scenarios into one TTT Database. • Started Reliability scripting work and Data population • Finalized Quickr Configuration Matrix; Domino & J2EE. • Risks/Issues/Concerns: • J2EE builds failing UAT • Reliability J2EE Quickr 8002 work has eaten into our prep time for Quickr 8.1. • Impact is Data Population and Reliability scripting work for Quickr 8.1. • SVT are trying to multi task between 8002 work 8.1 prep to mitigate this risk. • Need to complete 8002 in Nov. • SVT Resource shortfall is still pending financial approval. Four resources for 1st Jan driving our status to yellow. • A number of DCUT items are reported as not going to make DCUT. Looking at staging testing around areas that are not going to make DCUT. • Key Milestones/Upcoming Work: • Finish review of LIs in plan for Quickr 8.1 and complete & review Test Scenario Updates. (29th Nov) • Finalize Quickr 8.1 SVT Execution Cycle and s-Curve in TTT. (29th Nov)

  17. LWM 1.0.0.1 SVT – Charts (REGRESSION PHASE) pls update

  18. LWM 1.0.0.1 SVT – Reliability (REGRESSION PHASE) pls update

  19. LWM 1.0.0.1 SVT – Charts (EXECUTION PHASE) pls update

  20. LWM 1.0.0.1 SVT – Reliability (EXECUTION PHASE) pls update

  21. LWM 1.0.0.1 SVT – Defect Backlog Charts(EXECUTION PHASE) pls update

  22. LWM 1.0.0.1 SVT – Defect Backlog Charts(EXECUTION PHASE) pls update

  23. LWM 1.0.0.1 Performance pls update • 600vUsers @ 9.8TPS with acceptable average response time. We are seeing stability issues though towards the end of the runs • Compare to LWM1.0, at 550 concurrent users, it saves about 50MB memory. • We can do better than 50MB • The large string of "lwm menu" has not been "string.intern"ed. So the defect 1060 has been reopened. The fix will give LWM 140M memory improvement. • The MSS Action List Paging still can be improved. The logic of Paging is: • Get work list from process server and store it into WPF variable Worklists. • Get check list from DB and store it into WPF variable Checklists. • Merge WorkLists and CheckLists to MyActions. And the MyActions is shown. So after merge the WorkLists and CheckLists is useless. • The suggestion is: after merging, set WorkLists and CheckLists to empty. For example webappaccess.getVariables().setXml("WorkLists", null);

  24. Lotus Connections 1.0 – Capacity Planning Process – Mohamed Bachiri pls update • Completed capacity planning tools & training

  25. Lotus Connections 1.0.2 – (Early Program) pls update Accomplishments • Product has shipped. Customers working with the 1.0.2 Release • Reinmetal Looking for Deployment of the CEO Collaboration Bundle of ST Quickr and Connections. Primary interest in display of person card in Quickr. They are all set at the moment. • National Basketball Association (NBA) They will be downloading beta code as soon as available Hannover beta customers (expected number is 9) They will be downloading from the Hannover beta site, working with Jan Kenney to provide link from that site.

  26. Lotus Connections 1.0.2 Special SVT Status pls update

  27. Lotus Connections 1.0.2 Special SVT – IVT Status pls update

  28. Lotus Connections 1.0.2 Special TTT Status pls update

  29. Lotus Connections 1.0.2 – Reliability Workload pls update

  30. Workload & Configuration Individual Capacity Target Complete TPS Status AIX/DB2 GM Build Success criteria: Baseline – Expected to be performing at or better than Windows/DB2 Activities Nov. 12 ’07 25 tps Activities: GM needs to be reviewed Blogs: GM Communities: GM Dogear: GM needs to be reviewed Profiles: GM Blogs Nov. 12 ’07 69 tps Communities Nov. 12 ’07 17 tps Dogear Nov. 12 ’07 59 tps Profiles Nov. 12 ’07 51 tps Windows/DB2 Build no. LC1.0.2_2007xxxx Success criteria: No Regression from v1.0.1 Performance Results Activities 14 tps Activities: GC#1 Blogs: GC#1 Communities: GC#1 Dogear: GC#1 Profiles: GC#1 Blogs 91 tps Communities 11 tps Dogear 54 tps Profiles 28 tps Windows/Oracle GM Build Success criteria: All services performing comparably to Windows/DB2 Activities Nov. 12 ’07 25 tps Activities: GM, Blogs: GM Communities: GM Dogear: GM Profiles: GM Blogs Nov. 12 ’07 85 tps Communities Nov. 12 ’07 22 tps Dogear Nov. 12 ’07 54 tps Profiles Nov. 12 ‘07 49 tps Accomplishments: • Completed GM Measurements on all services for AIX/DB2 environment and Windows/Oracle • Completed Regression measurements for all services against GC#1 • Connections Sizing for Sprint Lotus Connections 1.0.2 – Performance pls update Upcoming Milestones • Identify reason performance becomes unacceptable Risks

  31. Workload & Configuration Individual Capacity Target Completed TPS Status Windows/SQL Server GM Build Success criteria: All services performing comparably to Windows/DB2 Activities Dec. 14, 2007 xx tps Activities: Blogs: Communities: Dogear: Profiles: Blogs Dec. 14, 2007 xx tps Communities Dec. 14, 2007 xx tps Dogear Dec. 14, 2007 xx tps Profiles Dec. 14, 2007 xx tps Benchmark Report Addendum AIX/DB2 Windows/Oracle Windows/SQL Server Mid-January, 2008 Lotus Connections 1.0.2 – Performance pls update Accomplishments: Upcoming Milestones • Windows/SQL Server measurements for individual services Risks

  32. Lotus Connections 2.0 – (Early Program) pls update Accomplishments • Created nomination form draft, gathering feedback from stake holders. Customers working with the Beta 2 Release TBD *Using Quickplace forum from Connections 1.0

  33. Workload & Configuration Individual Capacity Issues TPS Status “My HomePage” Windows/DB2 Build no. LC2.0_2007xxxx Success criteria: TBD Activities Activities: Blogs: Communities: Dogear: Profiles: Blogs Communities Dogear Profiles Lotus Connections 2.0 – Performance pls update Accomplishments: Upcoming Milestones • Define Goals for “Home Page” scenario • Define “Home Page” scenario • Create Performance Plan and Schedule • China team begin work on Dogear/Blogs 2.0 Risks

  34. Lotus Sametime Standard 8.0 – (Early Program) pls update • Accomplishments • Completed customer 1 x 1 meetings • Ship readiness approved by customers interviewed • Waiting for results for 72 hour run for go/no go ship decision • Connectria • “Ease of installation, maintenance and reliability in reaching its highest point with a mission-critical application like Sametime.” 1)Overall impression "thumb is just over middle." Halfway there with policy controls. Client stability has been very good. 2)The network installer initial load needs to be reduced; still need time to test other fixes. 3)Mac support a benefit. 4)Loving Quickr/Connection plug-ins. Taking the whole package from Lotus as one is a clear benefit, instead of trying to roll things out piecemeal. • E&Y • Supports shipment of ST8.0. Brett Van Gelder: “Will give it a proverbial thumbs up but, still needs to see the changes in beta5 build.” • Genentech • 1) Leopard support needs to be there. Currently the application will install, but will not run (Please note: after submitting the survey, Andy Wang from Genentech posted in the forum that Leopard is successfully up & running on test machines.) 2) Audio choppiness in Mac version (seems fine in Windows) 3) Minor interface clean up • Health Canada • Supports shipment of ST8.0: “This is a great improvement when you compare to version 6.5.1 (currently used in Health Canada). We are very anxious to start deploying it in production.” Upcoming Work • Close out All Forum issues • Track Customer SPR items that will be reviewed for the next ST release • Host final weekly meeting on 12/4/08

  35. Dependencies Status Issues/Risks/ Mitigation Plans Primary Owners: Tim Giambra System Test INTEROP • pls update INTEROP: attempts: DONE completes: DONE Last Week: Next 2 weeks: ATT=100%, COMP=100%, BLOCK/FAIL=0% Issues: Risks & Mitigations Slide 35

  36. Dependencies Status Issues/Risks/ Mitigation Plans • Yahoo assistance with workload run (external) Primary Owners: Tim Giambra System Test RELIABILITY pls update RELIABILITY: attempts: completes: Last Week: • Linux cluster: • Received fixes • Running since 11/26, 12:30pm (US time) • Linux standalone • Running on hardware (no Vmware image) • Running since 11/27, 6am (US time) Regression (24 hour runs) • AIX: running, Complete • Windows server: Complete ATT=100%, COMP=98%, BLOCK/FAIL=0% Issues/Defects: • Linux Risks & Mitigations Slide 36

  37. [ST 8.0] – [Status Date 11/26/07] pls update Slide 37

  38. IBM Gateway Pilot – [Status Date 11/26/07] pls update Carol Talton, Dave Curley, Ivan Dell’era Accomplishments/Status • ST server installation complete -Gateway installation started -LDAP problem workaround in place. Using domino ldap server on the ST server. More admin intensive, but does not have problems getting through the firewalls. Dependencies -AOL Cert – Waiting on AOL Cert from IBM CIO/Wolfe - We expect to obtain the CA, and have the AOL provision request processed by next week - then complete configuration. Road Blocks Encountered: See Dependency above. Other IBM Gateway Testing: No Change in Status Slide 38

  39. [ST 8.0 Advanced] – [Status Date 11/12/07] pls update Accomplishments/Status • Targeting SVT entry next week, exit approximately 3/10/08 • SVT test plan reviewed with development, entered into CTP • Draft Interop / Reliability test cases created, reviewing with development • System configuration started • Regular status meetings • Meeting with development to review early SVT priorities and code readiness • Daily meetings with test to review configuration / prep Issues and Concerns Dependencies - New tooling / API work with performance team (details TBD) Slide 39

  40. Sametime Performance –Mohamed Bachiri pls update • ST 8.0 Servers • ST 8.0 Client • ST 8.0 Advanced

  41. Scenario Workload Platform(s)‏ Objectives Planned Date (Results to dev)‏ Actual Results IM Server Windows 36,000 concurrent users 9/30 100% Complete (10/03)‏ Goal of 36,000 users reached Objectives met IM Server Linux 24,000 concurrent users 8/17 100% Complete (8/15)‏ 33,000 concurrent users Objectives exceeded IM Server AIX 30,000 concurrent users 10/31 Completed measurement (10/22)‏ Results: 30K concurrent users Sametime Gateway Windows 112,500 concurrent subscriptions (2250 users x 2 sides x 25 users in buddy list )‏ 10/31 for unclustered configuration Completed measurement (10/15)‏ Results: 112,500 subscriptions (with 4500 concurrent users – 2250 on each side of gateway – 25 users in buddy list)‏ Objectives met Additional measurement completed (11/15)‏ Results: 112500 subscriptions (with 22,500 concurrent users – 11,250 on each side of gateway – 5 users in buddy list)‏ ST 8.0 Server Performance Status pls update

  42. Scenario Workload Platform(s)‏ Objectives Planned Date Revised Date Actual Results WC Server, Presentation Mode, Single Large Meeting Windows  1700 concurrent users in a single meeting 9/14 10/10 Status: Measurements completed (10/9)‏ Results: Capacity is 1800 concurrent users Exceeded objectives WC Server, Presentation Mode, Single Large Meeting Linux  1700 concurrent users in a single meeting 9/28 10/12 (delay in Linux patch)‏ Working patch received on 10/17 New revised date 10/22 Status: measurement completed (10/22)‏ Results: 1100 concurrent users. Same as 7.5.1. Objective not achieved SPR #JLAE78APU4 IM Mobile Server; Small Buddy List Windows  20,000 concurrent users 9/17 New date is dependent on SPR fix ETA 10/15 New revised date (caused by delay in Linux patch)‏ 10/26 Status: Measurement completed Capacity reached: 17,500 Capacity for 7.5: 15,500 Capacity for 7.5 + patch: 20,000 Objective not achieved SPR #JLAE78AP6B IM Mobile Server; Small Buddy List Linux  20,000 concurrent users 10/10 11/07 Status: Measurement completed Capacity reached: 27k Exceeded objectives ST 8.0 Server Performance Status pls update

  43. Scenario Workload Platforms Objectives Planned Date Actual Results IM Client/Low End Desktop (T30)‏ Windows 10% reduction in (startup+login). compared w/ST 7.5.1 7/23 + Weekly Measurements • 100% Complete (7/23)‏ • Results: • 7.5.1 startup time + login time : 45.1 sec • 8.0 startup time + login time : 29.1 sec Exceeded objectives • See slides 5 & 6 IM Client/Low End Desktop (T30)‏ Linux 10% reduction in (startup+login). compared w/ST 7.5.1 9/14 • 100% Complete (9/15)‏ • Results: • 7.5.1 startup time + login time : 40.7 sec • 8.0 startup time + login time : 32.3 sec Exceeded objectives • See slide 7 IM Client/High End Desktop (T60) – for final publication Windows New baseline 10/12 Status: on track 8.0 startup time + login time :21.5 sec Blockers: None IM Client/High End Desktop Mac 10% reduction in (startup+login). compared w/ST 7.5.1 9/21 • 100% Complete (9/28)‏ • 7.5.1 startup time + login time: 19.9 sec • 8.0 startup time + login time : 21.4 sec • Objective not met. Investigating cause (JIT? NoVerify? # of classes loaded)‏ • See slide 7 IM Client/Low End Desktop (T30)‏ Windows Reduce memory footprint by 15% reduction compared with 7.5.1 footprint 7/23 • 100% Complete (7/23)‏ • Results: 39% reduction Exceeded objectives • See slide 9 ST 8.0 Server Performance Status – Client pls update

  44. Scenario Workload Platforms Objectives Planned Date Actual Results Office Integration (Measured ability to Launch ST from MS Outlook)‏ Windows This measurements was not part of the 8.0 objectives 7/23 + Weekly Measurements • Results: • Startup increased by 1.6 sec because of the 3 additional plug-ins loaded for MS Office integration • None of the other response times were effected ST 8.0 Server Performance Status – Client – MS Office Integration pls update

  45. Sametime 8.0 Client Cold Measurements pls update

  46. Sametime 8.0 Client Warm Measurements pls update

  47. Sametime 8.0 Client Cold Measurements (Linux & Mac)‏ pls update This number is used for assessing against Qplan/QCERT objectives

  48. Sametime 8.0 Client Warm Measurements (Linux & Mac)‏pls update

  49. ST 8.0 Client – Private Bytes pls update

  50. Leak Status Send/receive chats  • 3 separate leaks fixed • 4th leak – in Expeditor (IBM internal DMS deployment only)‏ • Fixed Emoticon (including emotion icons in chat messages)‏ • Fixed Screen bitmap grab/send • Could be deferred to 8.01 File transfer (leaking same listener object as above • Could be deferred to 8.01 Video Fixed ST 8.0 Client – Memory Leaks pls update

More Related