You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 23:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Dec 31, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2393799270,21cyclictest24236-21apt-get07:10:481
23937992617,2cyclictest12501-21idleruntime-cro09:00:001
2394099240,23cyclictest1075-21cron07:30:003
2394099240,0cyclictest13752-21apt-get11:15:503
2393899240,23cyclictest31065-21perf10:45:002
2393899240,1cyclictest0-21swapper/207:20:482
2393699240,23cyclictest28690-21cron07:20:000
2393699240,23cyclictest18473-21apt08:05:010
23940992320,3cyclictest13227-21apt-get07:55:023
2394099230,22cyclictest5289-21idleruntime-cro08:45:013
2393899230,22cyclictest759-21apt-get08:35:462
2393899230,22cyclictest12665-21cron12:20:002
2393899230,0cyclictest21759-21apt-get10:25:472
2393799230,22cyclictest20684-21ls11:30:001
2393799230,22cyclictest18480-21latency_hist08:05:011
23936992320,2cyclictest17763-21sh09:10:000
2393699230,22cyclictest3097-21idleruntime-cro12:00:010
2393699230,22cyclictest22591-21latency_hist09:20:010
2393699230,22cyclictest20667-21cron11:30:000
2393699230,22cyclictest16623-21turbostat10:15:010
2394099220,21cyclictest6343-21apt-get07:40:463
2394099220,21cyclictest6031-21latency_hist07:40:013
2394099220,21cyclictest0-21swapper/311:45:473
2394099220,21cyclictest0-21swapper/309:20:493
2394099220,0cyclictest0-21swapper/310:15:493
23938992222,0cyclictest0-21swapper/211:20:492
23938992220,1cyclictest0-21swapper/211:05:022
2393899221,20cyclictest0-21swapper/209:10:002
2393899220,2cyclictest28639-21dump-pmu-power10:40:002
2393899220,21cyclictest31372-21apt-get10:45:492
2393899220,21cyclictest26012-21apt-get08:20:482
2393899220,21cyclictest21015-21apt-get11:30:482
2393899220,21cyclictest0-21swapper/210:15:012
23937992221,0cyclictest0-21swapper/108:45:491
23937992220,1cyclictest22362-21basename12:40:011
23937992220,1cyclictest0-21swapper/110:00:001
2393799220,21cyclictest606-21dbus-daemon11:15:011
2393799220,21cyclictest32521-21apt-get09:40:501
2393799220,21cyclictest30803-21apt-get08:30:491
2393799220,21cyclictest29047-21apt-get07:20:481
2393799220,21cyclictest16225-21apt-get11:20:491
2393799220,21cyclictest0-21swapper/111:05:491
2393799220,21cyclictest0-21swapper/110:30:011
2393799220,21cyclictest0-21swapper/107:55:021
2393799220,1cyclictest0-21swapper/109:40:011
2393799220,1cyclictest0-21swapper/109:35:011
23936992220,1cyclictest0-21swapper/011:25:010
23936992219,2cyclictest5494-21dump-pmu-power12:05:010
23936992219,2cyclictest16067-21tr08:00:010
2393699221,1cyclictest24162-21apt-get10:30:460
2393699220,21cyclictest8744-21apt-get07:45:480
2393699220,21cyclictest8744-21apt-get07:45:480
2393699220,21cyclictest30305-21apt-get11:50:020
2393699220,21cyclictest1101-21perf07:30:000
2393699220,21cyclictest10442-21apt-get08:55:500
2393699220,21cyclictest0-21swapper/011:45:000
2393699220,21cyclictest0-21swapper/008:50:470
2393699220,21cyclictest0-21swapper/008:05:470
23940992121,0cyclictest3423-21apt-get12:00:483
23940992120,1cyclictest16405-21apt-get08:00:483
23940992119,1cyclictest15379-21perf09:05:003
23940992119,1cyclictest0-21swapper/310:30:473
23940992118,3cyclictest0-21swapper/312:15:493
2394099210,20cyclictest7294-21apt-get09:55:493
2394099210,20cyclictest29789-21idleruntime-cro09:35:013
2394099210,1cyclictest28980-21apt-get10:40:513
2394099210,1cyclictest18619-21apt-get11:25:493
2394099210,1cyclictest0-21swapper/312:10:013
23938992120,1cyclictest28229-21apt-get11:45:472
23938992120,1cyclictest11358-21apt-get11:10:502
23938992120,1cyclictest11139-21apt-get07:50:482
23938992120,1cyclictest0-21swapper/211:30:002
23938992119,1cyclictest15160-21perf12:25:002
23938992119,1cyclictest1345-21apt-get10:50:482
23938992119,1cyclictest11797-21wc10:05:002
2393899210,20cyclictest20265-21apt-get12:35:482
2393899210,1cyclictest20491-21apt-get09:15:492
2393899210,0cyclictest0-21swapper/210:15:492
23937992120,1cyclictest0-21swapper/111:00:481
23937992119,2cyclictest3441-21perf10:55:001
23937992119,1cyclictest27405-21basename09:30:011
23937992119,1cyclictest19044-21apt10:20:011
23937992119,1cyclictest10283-21awk12:15:011
2393799210,21cyclictest0-21swapper/110:35:481
2393799210,21cyclictest0-21swapper/109:15:491
2393799210,1cyclictest0-21swapper/111:35:491
2393799210,0cyclictest0-21swapper/107:25:461
23936992121,0cyclictest0-21swapper/008:45:490
23936992121,0cyclictest0-21swapper/008:15:480
23936992121,0cyclictest0-21swapper/007:40:460
2393699210,20cyclictest12104-21apt-get10:05:470
2393699210,1cyclictest20176-21dump-pmu-power09:15:000
2393699210,1cyclictest11358-21apt-get11:10:490
2393699210,0cyclictest0-21swapper/008:25:470
23940992020,0cyclictest0-21swapper/311:55:493
23940992020,0cyclictest0-21swapper/311:50:483
23940992020,0cyclictest0-21swapper/311:10:503
23940992020,0cyclictest0-21swapper/310:10:493
23940992020,0cyclictest0-21swapper/309:45:483
23940992019,1cyclictest30497-21perf08:30:013
23940992019,0cyclictest0-21swapper/308:20:473
23940992014,5cyclictest0-21swapper/307:10:483
2394099200,19cyclictest0-21swapper/308:50:473
2394099200,0cyclictest1410-21apt-get07:30:453
23938992020,0cyclictest31438-21apt-get07:25:462
23938992020,0cyclictest0-21swapper/212:30:492
23938992020,0cyclictest0-21swapper/209:50:472
23938992020,0cyclictest0-21swapper/209:00:022
23938992020,0cyclictest0-21swapper/208:55:502
23938992020,0cyclictest0-21swapper/207:35:482
23938992019,1cyclictest19366-21apt-get10:20:482
23938992018,1cyclictest0-21swapper/212:15:012
2393899200,1cyclictest8225-21cron11:05:012
23937992020,0cyclictest0-21swapper/112:05:481
23937992020,0cyclictest0-21swapper/111:50:481
23937992020,0cyclictest0-21swapper/108:50:471
23937992018,1cyclictest30476-21cron08:30:011
2393799200,20cyclictest0-21swapper/109:45:481
2393799200,0cyclictest0-21swapper/111:15:501
2393799200,0cyclictest0-21swapper/109:00:491
23936992020,0cyclictest0-21swapper/011:30:480
23936992020,0cyclictest0-21swapper/011:05:500
23936992020,0cyclictest0-21swapper/010:20:480
23936992020,0cyclictest0-21swapper/009:00:020
23936992020,0cyclictest0-21swapper/007:30:450
2393699200,0cyclictest0-21swapper/010:55:500
2393699200,0cyclictest0-21swapper/010:15:490
23940991919,0cyclictest25835-21apt-get11:40:503
23940991919,0cyclictest25310-21apt-get09:25:483
23940991919,0cyclictest0-21swapper/312:30:493
23940991919,0cyclictest0-21swapper/311:35:493
23940991919,0cyclictest0-21swapper/311:00:483
23940991919,0cyclictest0-21swapper/310:55:503
23940991919,0cyclictest0-21swapper/310:35:483
23940991919,0cyclictest0-21swapper/309:35:473
23940991917,1cyclictest15141-21cron12:25:003
2394099190,18cyclictest5601-21apt-get08:45:493
23938991919,0cyclictest996-21apt-get11:55:502
23938991919,0cyclictest31020-21apt-get11:50:482
23938991919,0cyclictest0-21swapper/210:05:472
23938991919,0cyclictest0-21swapper/207:45:482
23938991919,0cyclictest0-21swapper/207:45:482
23938991917,1cyclictest27397-21munin-run09:30:012
23937991919,0cyclictest21193-21apt-get08:10:481
23937991919,0cyclictest0-21swapper/110:30:471
23937991919,0cyclictest0-21swapper/110:20:481
23937991919,0cyclictest0-21swapper/110:00:481
23937991919,0cyclictest0-21swapper/108:40:491
23937991917,1cyclictest8411-21cron07:45:011
23937991917,1cyclictest0-21swapper/107:30:451
23937991916,2cyclictest27896-21awk11:45:001
23936991919,0cyclictest0-21swapper/011:00:480
23936991919,0cyclictest0-21swapper/010:45:490
23936991919,0cyclictest0-21swapper/010:35:480
23936991919,0cyclictest0-21swapper/009:55:490
23936991919,0cyclictest0-21swapper/009:50:480
23936991919,0cyclictest0-21swapper/008:40:490
23936991919,0cyclictest0-21swapper/008:10:490
23936991919,0cyclictest0-21swapper/007:25:000
23936991919,0cyclictest0-21swapper/007:10:480
23940991818,0cyclictest0-21swapper/312:10:513
23940991818,0cyclictest0-21swapper/308:55:503
23940991818,0cyclictest0-21swapper/308:05:473
23940991815,3cyclictest0-21swapper/311:05:023
2394099180,18cyclictest0-21swapper/309:13:473
2394099180,14cyclictest9003-21cstates07:45:493
2394099180,14cyclictest9003-21cstates07:45:493
23938991818,0cyclictest0-21swapper/212:05:012
23938991818,0cyclictest0-21swapper/209:30:472
23938991818,0cyclictest0-21swapper/209:10:492
23938991818,0cyclictest0-21swapper/207:15:492
23938991817,1cyclictest30102-21apt-get09:35:472
23938991817,0cyclictest15475-21apt-get12:25:502
23938991816,1cyclictest20885-21munin-run08:10:002
23938991815,2cyclictest15891-21idleruntime-cro11:20:012
23937991818,0cyclictest0-21swapper/112:25:501
23937991818,0cyclictest0-21swapper/110:10:491
23937991818,0cyclictest0-21swapper/109:10:491
23937991818,0cyclictest0-21swapper/108:20:481
23937991817,0cyclictest0-21swapper/108:35:461
23937991816,2cyclictest14244-21latency_hist10:10:011
23937991816,1cyclictest0-21swapper/107:50:011
23937991816,1cyclictest0-21swapper/107:50:011
23936991818,0cyclictest28229-21apt-get11:45:470
23936991818,0cyclictest0-21swapper/011:35:490
23936991818,0cyclictest0-21swapper/009:20:480
23936991818,0cyclictest0-21swapper/007:50:480
23936991817,1cyclictest15894-21turbostat11:20:010
23936991816,1cyclictest31070-21munin-run10:45:000
23940991717,0cyclictest32521-21apt-get09:40:493
23940991717,0cyclictest0-21swapper/310:20:483
23940991717,0cyclictest0-21swapper/308:15:483
23940991717,0cyclictest0-21swapper/308:10:493
23940991715,2cyclictest0-21swapper/310:50:483
2394099170,0cyclictest0-21swapper/310:45:553
23938991717,0cyclictest0-21swapper/211:35:492
23938991717,0cyclictest0-21swapper/210:55:502
23938991717,0cyclictest0-21swapper/209:45:482
23938991717,0cyclictest0-21swapper/209:40:502
23938991717,0cyclictest0-21swapper/208:40:492
23938991717,0cyclictest0-21swapper/208:15:002
23938991717,0cyclictest0-21swapper/207:55:462
23938991717,0cyclictest0-21swapper/207:40:462
23937991716,0cyclictest0-21swapper/111:45:471
23937991715,1cyclictest6977-21cat09:55:001
23937991715,1cyclictest3755-21apt-get10:55:501
23937991715,1cyclictest13238-21dpkg07:55:011
23937991714,2cyclictest5511-21apt12:05:011
23936991717,0cyclictest30102-21apt-get09:35:480
23936991717,0cyclictest0-21swapper/012:25:500
23936991717,0cyclictest0-21swapper/008:30:490
23940991616,0cyclictest0-21swapper/312:25:503
23940991616,0cyclictest0-21swapper/310:25:483
23940991616,0cyclictest0-21swapper/308:30:493
23940991616,0cyclictest0-21swapper/307:20:483
23940991614,1cyclictest22608-21awk09:20:013
23938991616,0cyclictest5816-21apt-get12:05:482
2393799160,15cyclictest11245-21hddtemp_smartct12:15:511
23936991616,0cyclictest0-21swapper/012:15:490
23936991616,0cyclictest0-21swapper/010:25:480
23936991616,0cyclictest0-21swapper/009:40:500
23936991616,0cyclictest0-21swapper/009:25:480
23936991616,0cyclictest0-21swapper/007:35:480
23936991615,1cyclictest2502-21apt-get09:45:480
23940991515,0cyclictest0-21swapper/307:50:483
23940991514,1cyclictest18315-21grep11:25:013
23940991514,1cyclictest0-21swapper/310:01:343
2394099150,0cyclictest0-21swapper/312:39:533
23938991515,0cyclictest0-21swapper/210:30:472
23938991515,0cyclictest0-21swapper/208:45:492
23938991515,0cyclictest0-21swapper/208:15:482
23938991515,0cyclictest0-21swapper/207:10:482
2393899150,14cyclictest0-21swapper/209:20:082
2393799155,6cyclictest0-21swapper/111:55:501
23937991515,0cyclictest0-21swapper/112:30:491
23937991514,1cyclictest3821-21apt-get07:35:471
23937991514,1cyclictest25675-21sh08:20:001
2393699152,12cyclictest29762-21cron09:35:010
23936991515,0cyclictest0-21swapper/012:10:510
23936991513,1cyclictest19954-21wc12:35:000
23940991414,0cyclictest0-21swapper/308:35:183
2394099140,14cyclictest0-21swapper/309:50:293
2394099140,14cyclictest0-21swapper/309:05:173
2394099140,14cyclictest0-21swapper/307:16:253
2394099140,0cyclictest0-21swapper/311:30:023
2394099140,0cyclictest0-21swapper/310:06:113
23938991414,0cyclictest0-21swapper/211:40:492
23938991414,0cyclictest0-21swapper/208:30:012
2393899140,7cyclictest8041-21apt-get08:50:472
2393899140,14cyclictest0-21swapper/208:25:192
2393899140,14cyclictest0-21swapper/208:00:222
2393899140,0cyclictest0-21swapper/207:31:422
23937991414,0cyclictest0-21swapper/111:32:261
23937991414,0cyclictest0-21swapper/110:45:491
23937991414,0cyclictest0-21swapper/110:40:041
23937991414,0cyclictest0-21swapper/109:05:111
2393799140,14cyclictest0-21swapper/108:05:121
2393799140,14cyclictest0-21swapper/107:15:361
2393799140,0cyclictest0-21swapper/109:20:201
23936991414,0cyclictest0-21swapper/012:35:230
23936991414,0cyclictest0-21swapper/012:20:490
23936991414,0cyclictest0-21swapper/010:50:130
23936991414,0cyclictest0-21swapper/008:20:340
2393699140,14cyclictest0-21swapper/012:05:420
2393699140,14cyclictest0-21swapper/008:35:040
2393699140,0cyclictest0-21swapper/010:00:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional