|
|
Return to Home | |
|
Andrew Young 2024 Summary |
|||
Name |
Date |
Week Ending |
This week |
Office Date |
Obstacles |
|---|---|---|---|---|---|
| Andrew Lee-Young | 9/27/2024 | Friday, September 27, 2024 | ING-813 finished scripts to allow for bulk testing. will deploy next week | Wednesday, September 18, 2024 | no obstacles! |
| Andrew Lee-Young | 9/20/2024 | Friday, September 20, 2024 | ING-813: completed testing of Water Level sensors. Now testing Met sensors | Monday, September 16, 2024 | No obstacles! |
| Andrew Lee-Young | 9/13/2024 | Friday, September 13, 2024 | ING-813: setup of large testing script to compare all test results for all sensors previously developed. A1, V1, Y1 completed | Monday, September 9, 2024 | No obstacles! Thanks |
| Andrew Lee-Young | 9/6/2024 | Friday, September 6, 2024 | ING-813: large scale testing scripts for WL/Met QC Python rewrite. These scripts allow the comparison of every row and column of the output of Fortran vs Python code. There exist bugs that prevent the script from running that need to be resolved. One of the bugs: if the files do not have the exact number of lines, the comparison will not run. The script needs to be able to determine which file has fewer or more rows, and then if those rows are errors or correct. Extra A2 rows have already been identified in the legacy Fortran code which was deemed an error by Federal teammates. Handling discrepancies like this will take time. | Monday, September 2, 2024 | No obstacles |
| Andrew Lee-Young | 8/30/2024 | Friday, August 30, 2024 | ING-798: completed, closed, and gave a demo to the Fed Employees in ISD. ING-813: new ticket to automate the testing from ING-798 | Wednesday, August 28, 2024 | no obstacles |
| Andrew Lee-Young | 8/23/2024 | Friday, August 23, 2024 | ING-798: completed work for Polled sensor calculations. Will present a demo to the Federal employee teammates next week | Monday, August 19, 2024 | No obstacles! |
| Andrew Lee-Young | 8/16/2024 | Friday, August 16, 2024 | I was on Annual Leave / Vacation. I will return to the office on Monday August 19! Thank you :) | NA | None |
| Andrew Lee-Young | 8/9/2024 | Friday, August 9, 2024 | ING-802: completed and closed ING-798: updates for Met sensor testing. D1, E1, F1, J1, L1, M1. Remaining sensors that are not completed G1, O1. FYI, I am on vacation Mon Aug 12 - Fri Aug 16 | NA | No obstacles. |
| Andrew Lee-Young | 8/2/2024 | Friday, August 2, 2024 | ING-802: finished bug fixes for U1 and Y1 sensors. N1 sensors are remaining. | NA | Same as last week, my car is in the shop and I am unable to commute. I will be able to return to the office soon. |
| Andrew Lee-Young | 7/26/2024 | Friday, July 26, 2024 | ING-802: enabled other water level sensors for testing. B1, Q1, U1, V1, Y1. There are small errors in each sensor that need to be corrected. | NA | My car broke down this week and I was unable to commute to the office. It will be repaired by next Wed July 31 at the earliest. Thanks! |
| Andrew Lee-Young | 7/19/2024 | Friday, July 19, 2024 | ING-797: testing completed and passed. bulk testing for A1 is an exact match for the certain 6 minute time windows that I selected. However, not all sensors can be tested, as not every station or sensor sends data every 6 minutes. More testing is needed. Being 100% sure is a larger task that requires 24/7 operation | Monday, July 15, 2024 | No obstacles |
| Andrew Lee-Young | 7/12/2024 | Friday, July 12, 2024 | ING-797: Refactored code to allow for 2 run modes: single station testing and bulk station testing. Previously only single station manual testing was available. With the refactor we can now test all stations at a time with high accuracy. Rounding errors of 0.01 > 0.001 need to be fixed. This is for Satellite Water Level A1 sensors. | Wednesday, July 10, 2024 | No obstacles! |
| Andrew Lee-young | 7/5/2024 | Friday, July 5, 2024 | ING-797: Refactoring WL/Met QC Python software to utilize a cache of all station metadata instead of reading in one file at a time. This should result in a massive increase in execution speed | Wednesday, July 03, 2024 | No obstacles! |
| Andrew Lee-Young | 6/28/2024 | Friday, June 28, 2024 | ING-791 Persistent Data Serialization for Large Scale Testing: the cached data is deployed and working in DEV. Initial discussions and testing with Feds on my team were good. We are already seeing our process running 2.4x faster. While that is good, we will ultimately see much greater optimizations in a phase 2 or 3 of this optimization. Now that this is complete, I will continue testing. In this case, Meteorological sensors as a part of the WL/Met QC Python rewrite. | Monday, June 24, 2024 | No obstacles! |
| Andrew Lee-Young | 6/21/2024 | Friday, June 21, 2024 | ING-791: Persistent Data Serialization for Large Scale Testing This ticket is an optimization for the WL/Met QC project. The current (legacy Fortran) WL/Met QC reads in static files one at a time. This optimization allows for all static files to be read in only when the data is refreshed by the getMetadata service. I cannot remember the timing, usually every 10-20minutes (I think). This cuts down on an incredible number of file reads. Instead of reading hundreds, if not thousands of files in a 10 minutes window. It happens once. And is available for Python software to utilize. The optimization is not yet complete, but will be complete the week of Friday June 28. Thanks! | NA | No obstaces, however, I understand the attendance requirement of being in-office once per week. Due to my scheduled time-off, I have missed the past two attendance reports. This was just an FYI, that it may appear like my June attendance was low. It was because of vacation. Thanks! |
| Andrew Lee-Young | 6/10/2024 | Friday, June 14, 2024 | In preparation for my leave. I am submitting my weekly checkin early. For the week ending on Friday June 14: ING-791: a script was written and tested. this script maintains a cache of station database metadata on the dev server. This script runs independently of the Python rewrite software. Next steps: run this script every time database metadata is refreshed. This refresh occurs every 50 minutes. | NA | No obstacles |
| Andrew Lee-Young | 6/7/2024 | Friday, June 7, 2024 | ING-791: Persistent Data Serialization for Large Scale Testing. Set up a service to store database metadata to remove file i/o overhead | Monday, June 03, 2024 | No obstacles |
| Andrew Lee-Young | 5/31/2024 | Friday, May 31, 2024 | ING-771: large scale WL/Met QC testing for A1, B1, Q1, V1, Y1 complete. Now testing N1/T1/NT and U1. Testing is going well. Because individual modules were tested rigorously, there are very few (for some- no errors) when testing end to end. Time constraints are currently a big issue. WL/Met software was originally designed in the 1990's with a 2 minute constraint. It currently takes the Fortran software about 60-80 seconds to run. I am running my Python rewrite in tandem, which gives me less than a minute to calculate everything that Fortran does. This is not ideal and will require a lot of work to run in parallel instead of tandem/sequentially. | NA | No obstacles |
| Andrew Lee-Young | 5/24/2024 | Friday, May 24, 2024 | ING-771: bulk testing for GOES Water Level sensors for the Python rewrite of the legacy Fortran software. Sensors tested: A1, Q1, V1, Y1. All passing tests. Sensors remaining: B1, N1, T1, NT | Wednesday, May 22, 2024 | no obstacles! |
| Andrew Lee-Young | 5/16/2024 | Friday, May 17, 2024 | ING-771 Bulk testing for GOES A1 sensor passed. Moving on to bulk testing for other acoustic sensors! This is a huge step, as it marks a point where the python software is able to match the Legacy Fortran (to be deprecated) 1 to 1! There are a lot of sensors and running in real-time is still a ways away. But this is a large milestone. Also reminder, I will be out of office on Friday 5/17, so I will be unable to attend the Monthly Touchpoint Meeting. | Monday, May 13, 2024 | No obstacles! Thank you |
| Andrew Lee-Young | 5/10/2024 | Friday, May 10, 2024 | ING-711: Bulk testing complete. Errors have been identified and are being fixed. | Monday, May 06, 2024 | No obstacles |
| Andrew Lee-Young | 5/3/2024 | Friday, May 3, 2024 | ING-771: integrating Python software testing with legacy Fortran software and documenting bugs / errors | Monday, April 29, 2024 | No obstacles. |
| Andrew Lee-Young | 4/26/2024 | Friday, April 26, 2024 | ING-771: creating a test environment to run new Python software (WL/Met QC as part of the modernization project) together with the legacy software (Fortran); such that bulk testing can be done. ETA(2-4 weeks) | Wednesday, April 24, 2024 | No obstacles! |
| Andrew Lee-Young | 4/19/2024 | Friday, April 19, 2024 | ING-754, ING-755: Q1 (air gap) and R1 (relative humidity) sensor calculations tested and complete ING-754 closed ticket details: work started Mar 1 2024. Total work time 1w 2d. ING-755 closed ticket details: work started Mar 1 2024. Total work time 1w 1d | NA | no obstacles, thank you |
| Andrew Lee-Young | 4/13/2024 | Friday, April 12, 2024 | ING-754, ING-755: testing complete and closed. total hours will be updated ING-751: testing all sensors for GOES and polled data (eta 2-4 weeks) | Monday, April 8, 2024 | no obstacles, thank you! |
| Andrew Lee-Young | 4/5/2024 | Friday, April 5, 2024 | ING-754, ING-755 development complete, testing complete. tickets to close next week | Thursday, April 4, 2024 | No obstacles thank you! |
| Andrew Lee-Young | 3/29/2024 | Friday, March 29, 2024 | ING-754: Q1 air gap sensor capabilities. development complete. now in testing ING-755: R1 relative humidity sensor capabilities. development complete. now in testing. | Wednesday, March 27, 2024 | No obstacles, happy Easter! |
| Andrew Lee-Young | 3/22/2024 | Friday, March 22, 2024 | ING-751: Testing and bug fixes. I spoke with NOAA federal teammates and we decided that this ticket will have a new due date because of a change in scope. It previously was only for GOES testing and fixes. It is now for GOES and POLLED testing and fixes. ING-754: New ticket in development Q1 Air Gap sensor calculations | Monday, March 18, 2024 | No obstacles. thank you |
| Andrew Lee-Young | 3/15/2024 | Friday, March 15, 2024 | ING-751: NOAA Federal teammates conducted testing and provided feedback and errors that occurred during testing. Those errors were worked on the week of Monday March 11 -> Friday March 15. The fixes have been deployed and will be re-tested next week. Changes include: Updates to sensor modules A, B, C, D, E, F, G, J, U, V, Y for polled data. Bug fixes for L, M, N sensors with polled and GOES data. Also, be advised that this ticket is past the due date because of the updates required. Once testing is complete, the hours required to complete and ticket status will be updated. Thanks ETA until ticket completion (approx 1 week) | Thursday, March 14, 2024 | No obstacles. Thanks! |
| Andrew Lee-Young | 3/8/2024 | Friday, March 8, 2024 | ING-738: G1 sensor capabilities. ticket completed and closed ING-751: U1, Y1, and other fixes. Federal teammates requested that 'polled' data be fixed and added into this ticket as part of the testing effort. Current sensors that have been fixed for polled data: A1, B1, C1, E1, F1, G1, V1, Y1. Testing to come next week Time until ticket completion (eta 1-2 weeks) | NA | No obstacles thank you! |
| Andrew Lee-Young | 2/29/2024 | Thursday, February 29, 2024 | ING-738: time logged, testing completed, ticket closed. Total time in development 1w. Ticket created on Feb 01, 2024. This ticket has a lot of idle time as it was waiting for ING-751 ING-751 time logged, currently in testing. Estimated time until completion 1-2weeks ING-754 Q1, new ticket ING-755 R1, new ticket | Monday, February 26, 2024 | No obstacles |
| Andrew Lee-Young | 2/23/2024 | Friday, February 23, 2024 | ING-738: finished development and available for testing ING-751: bug fixes for A1, B1, U1, Y1 sensor calculations. C1 and T1 sensors have outstanding issues that need help from Federal team members | Wednesday, February 21, 2024 | No obstacles thank you |
| Andrew Lee-Young | 2/16/2024 | Friday, February 16, 2024 | ING-728 N1/T1/NT sensor recalculation. CLOSED. time to completion: about 4-5 weeks. ING-738 G1 sensor calculation, development complete. Testing available in dev. estimated time to completion 1-2 weeks ING-751 U1, Y1, and other sensor recalculation. New ticket. Started development. Estimated time to completion 2-3 weeks. | NA | No obstacles. Thank you! |
| Andrew Lee-Young | 2/9/2024 | Friday, February 9, 2024 | ING-728: N1,T1,NT sensor calculations and bug fixes. team members determined that the work has passed testing and ticket is complete. will close. estimated time for task (about 4-5 weeks) ING-738: G1 (conductivity) meteorological sensor capabilities. started development. testing to occur next week. estimated time to completion 1-2 weeks. ING-751: U1, Y1, and other bug fixes. testing that occurred before the New Year highlighted some previous bugs and issues with other sensors. This ticket was created to address those errors. start date: TBD after ING-738. estimated time to completion 2-4 weeks after start date. | Monday, February 5, 2024 | No obstacles thank you! |
| Andrew Lee-Young | 1/31/2024 | Wednesday, January 31, 2024 | ING-728: testing completed and handed off to other NOAA Federal team members. Preparing to close ticket. ING-738: G1 Conductivity sensor capabilities, started development. | Friday, January 26, 2024 | No obstacles, thank you! |
| Andrew Lee-Young | 1/29/2024 | Friday, January 26, 2024 | ING-728 N1/T1/NT calculation fixes. final testing. will hand off to rest of the NOAA team this week. estimated time until completion < 1 week ING-738: G1 Conductivity sensor. New ticket to begin work after N1/T1/NT | Monday, January 22, 2024 | No obstacles |
| Andrew Lee-Young | 1/19/2024 | Friday, January 19, 2024 | Weather and snow created office closures for office attendance. ING-728 N1/T1/NT Sensor capability and recalculation. Development on this sensor is complete and is in testing on the development server ING-738 G1 Conductivity sensor capability development. New ticket to begin work after 728 is complete & closed | NA | No obstacles. Thank you |
| Andrew Lee-Young | 1/12/2024 | Friday, January 12, 2024 | ING-728 development complete. Testing to complete next week. ETA 1-2 weeks | Wednesday, January 10, 2024 | No obstacles! Thank you! |
| Andrew Lee-Young | 1/5/2024 | Friday, January 5, 2024 | ING-728: N1 Pressure sensor capabilities. This sensor was previously worked on and after doing bulk testing with the team. We discovered some bugs. This is a complicated group of sensors that will take time to fix. ETA 4-6 weeks. N1 Barometric Pressure is a combination sensor N1, T1, and NT. These sensors all need their own calculations and are also dependent upon each other's measurements | Thursday, January 5, 2024 | No obstacles thank you! |