Back to the main page.
Bug 1865 - test script e-mail should list the differences to the previous one
| Status | CLOSED FIXED |
| Reported | 2012-11-29 11:14:00 +0100 |
| Modified | 2013-09-18 13:19:14 +0200 |
| Product: | FieldTrip |
| Component: | test |
| Version: | unspecified |
| Hardware: | PC |
| Operating System: | Windows |
| Importance: | P3 normal |
| Assigned to: | Robert Oostenveld |
| URL: | |
| Tags: | |
| Depends on: | |
| Blocks: | |
| See also: |
Eelke Spaak - 2012-11-29 11:14:51 +0100
Like this: The following test scripts have started failing since the last e-mail was sent: XX XX The following test scripts have started running successfully since the last e-mail was sent: XX XX The following test scripts are still failing: XX XX
Robert Oostenveld - 2012-11-29 11:24:29 +0100
I have added cp report.txt report_previous.txt to the email script The next time it runs I will have something to compare. Note that the report.txt looks like 7056 test_bug1035 1035 passed 2.479 7056 test_bug1040 1040 passed 1.886 7056 test_bug1041 1041 passed 1.734 7055 test_bug1042 1042 passed 118.093 7056 test_bug1043 1043 passed 4.096 7055 test_bug1049 1049 passed 53.0 7056 test_bug1082 1082 failed 4.272 7056 test_bug1149 1149 passed 0.623 7055 test_bug1150 1150 passed 35.905 7055 test_bug1153 1153 passed 0.627 ... a simple diff will fail because of the first (revision) and the last (time) column. Some smart awk/perl/php script would be needed to parse the two versions of this and produce the desired output. @Eelke: Could you write that?
Eelke Spaak - 2012-11-29 11:25:41 +0100
Sure. Where do the scripts live?
Robert Oostenveld - 2012-11-29 11:45:31 +0100
Created attachment 382 report.txt file as it is sent by mail from the linux command line
Roemer van der Meij - 2012-11-29 12:05:15 +0100
Wonderful! That would be a wonderful improvement. Once this works, the following should be child's play, and will add to the usefulness of the email. Subject line now reads: *** FieldTrip dashboard errors 2012-11-28 *** I propose to change this to: *** Dashboard: +X/-X fails since previous_date *** The most important part being the +X or -X, indicating the difference in number of fails to the previous report.
Eelke Spaak - 2012-11-30 12:28:15 +0100
Created attachment 385 shell script to generate the e-mail The attached script should do the work as requested.
Eelke Spaak - 2012-11-30 12:31:33 +0100
Hold on! Still working on generating a new subject line as well.
Eelke Spaak - 2012-11-30 12:46:39 +0100
Created attachment 386 generation script v2 New attachment; now also a dashboardemail_subject.txt file is generated to use as the email subject.
Robert Oostenveld - 2012-11-30 19:40:51 +0100
I'll give it a try.
Eelke Spaak - 2012-12-30 08:49:36 +0100
The script seems broken; the same tests are listed as 'new passes' each time again. Is this due to a bug in my script? If so, you can assign the bug to me. Or could it be due to the copying of report_previous?
Robert Oostenveld - 2012-12-31 10:40:35 +0100
there seems to be some file naming confusion roboos@mentat002> ll total 160 drwxr-xr-x 7 roboos mrphys 4096 Dec 29 13:53 dashboard -rw-r--r-- 1 roboos mrphys 1338 Dec 28 17:00 dashboardemail.txt -rw-r--r-- 1 roboos mrphys 72662 Dec 31 10:38 dashboard.txt -rw-r--r-- 1 roboos mrphys 21123 Dec 28 17:00 previous_report.txt -rw-r--r-- 1 roboos mrphys 19850 Dec 5 16:53 report_previous.txt -rw-r--r-- 1 roboos mrphys 21122 Dec 31 10:38 report.txt Yup, these are due to some adjustments that I made to the mail script to build it into the rest of the dashboard. I have just fixed it.
Robert Oostenveld - 2013-08-07 17:20:53 +0200
as of some time we get regular emails with the differences highlighted, so this bug has been resolved.