You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 08:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Dec 11, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310299260,20cyclictest19781-21sh23:04:591
310299260,1cyclictest593-21dbus-daemon21:15:011
309899250,21cyclictest29420-21apt-get21:13:460
310799240,1cyclictest14805-21apt-get20:42:323
310499242,21cyclictest0-21swapper/220:18:502
310299240,0cyclictest0-21swapper/122:13:481
3098992424,0cyclictest28695-21apt-get22:18:450
3098992421,2cyclictest31822-21apt-get21:18:460
310799230,22cyclictest4652-21basename23:39:593
3104992323,0cyclictest28878-21perf21:10:002
3104992323,0cyclictest0-21swapper/221:23:482
3104992322,1cyclictest0-21swapper/222:13:472
3104992320,2cyclictest1276-21awk21:20:002
3102992321,1cyclictest24037-21sendmail-msp21:00:001
3102992320,2cyclictest0-21swapper/123:43:481
3102992319,3cyclictest0-21swapper/100:33:481
310299230,2cyclictest1147-21perf00:40:001
3098992321,1cyclictest0-21swapper/022:50:000
309899230,22cyclictest10102-21apt-get20:33:480
3107992221,0cyclictest20333-21apt-get23:08:483
3107992220,1cyclictest20896-21plymouth22:00:003
3107992220,1cyclictest16725-21cron00:05:003
3107992220,1cyclictest16084-21basename21:49:593
3107992220,1cyclictest0-21swapper/319:43:473
310799220,22cyclictest6486-21perf21:30:003
310799220,21cyclictest19758-21apt-get20:53:463
310799220,1cyclictest0-21swapper/321:55:003
310499229,12cyclictest15938-21ntpq00:03:522
3104992220,1cyclictest5370-21munin-run22:35:002
3104992220,1cyclictest11309-21munin-run21:40:002
3104992219,2cyclictest31147-21turbostat00:35:002
310499221,0cyclictest28-21ksoftirqd/222:18:492
310499220,21cyclictest0-21swapper/221:33:482
310499220,21cyclictest0-21swapper/200:23:502
310499220,1cyclictest0-21swapper/220:40:002
3102992221,0cyclictest0-21swapper/122:53:471
310299220,22cyclictest0-21swapper/123:18:481
310299220,21cyclictest26912-21apt-get00:28:471
310299220,21cyclictest0-21swapper/122:33:491
310299220,21cyclictest0-21swapper/100:03:471
310299220,1cyclictest7874-21munin-plugin-st19:20:001
310299220,1cyclictest23293-21basename22:05:011
310299220,1cyclictest13222-21apt-get19:33:471
310299220,1cyclictest0-21swapper/100:08:471
3098992222,0cyclictest7606-21apt-get23:48:480
3098992221,0cyclictest0-21swapper/019:28:490
3098992220,1cyclictest0-21swapper/021:35:000
309899220,21cyclictest6008-21apt-get19:18:470
309899220,21cyclictest23963-21perf00:20:000
309899220,21cyclictest15519-21apt-get22:58:480
309899220,21cyclictest0-21swapper/023:38:490
309899220,21cyclictest0-21swapper/023:10:000
309899220,21cyclictest0-21swapper/020:03:480
309899220,21cyclictest0-21swapper/019:33:470
309899220,1cyclictest0-21swapper/021:53:490
3107992119,1cyclictest612-21gdbus20:50:003
3107992119,1cyclictest14353-21apt20:40:003
310799210,20cyclictest31708-21apt-get00:38:513
310799210,20cyclictest12402-21apt-get23:58:493
310799210,20cyclictest0-21swapper/322:18:443
310799210,20cyclictest0-21swapper/319:38:463
310799210,20cyclictest0-21swapper/300:28:473
310799210,1cyclictest5303-21apt-get20:23:453
310799210,1cyclictest17304-21apt-get00:08:483
310799210,0cyclictest2885-21apt-get20:18:493
310799210,0cyclictest0-21swapper/322:58:483
3104992121,0cyclictest23304-21perf22:05:012
3104992121,0cyclictest0-21swapper/219:53:482
310499210,20cyclictest0-21swapper/221:28:502
310499210,20cyclictest0-21swapper/220:23:452
310499210,1cyclictest593-21dbus-daemon19:25:002
310499210,0cyclictest0-21swapper/222:53:472
3102992121,0cyclictest0-21swapper/121:38:461
3102992120,1cyclictest7702-21apt-get20:28:481
3102992119,1cyclictest24573-21apt-get23:15:001
310299210,1cyclictest17363-21apt-get20:48:481
310299210,0cyclictest0-21swapper/120:08:451
3098992121,0cyclictest5910-21apt-get22:38:470
3098992121,0cyclictest5910-21apt-get22:38:470
3098992121,0cyclictest0-21swapper/020:28:480
3098992120,1cyclictest22158-21apt-get20:58:490
3098992120,0cyclictest0-21swapper/022:53:470
3098992120,0cyclictest0-21swapper/000:25:000
3098992119,1cyclictest22283-21apt-get19:50:000
3098992118,3cyclictest431-21apt-get20:13:490
309899210,21cyclictest0-21swapper/000:13:490
309899210,20cyclictest8424-21apt-get19:23:470
309899210,20cyclictest1831-21apt-get21:23:480
309899210,20cyclictest0-21swapper/023:15:010
309899210,1cyclictest0-21swapper/023:58:480
309899210,1cyclictest0-21swapper/022:43:480
3107992020,0cyclictest26244-21apt-get22:13:483
3107992020,0cyclictest0-21swapper/322:43:493
3107992020,0cyclictest0-21swapper/321:23:493
3107992020,0cyclictest0-21swapper/319:53:483
3107992020,0cyclictest0-21swapper/319:13:463
3107992018,1cyclictest327-21apt-get23:33:463
310799200,20cyclictest0-21swapper/322:38:483
310799200,20cyclictest0-21swapper/322:38:483
310799200,20cyclictest0-21swapper/320:58:503
310799200,0cyclictest0-21swapper/300:23:503
3104992020,0cyclictest0-21swapper/223:33:472
3104992020,0cyclictest0-21swapper/223:23:482
3104992020,0cyclictest0-21swapper/222:48:472
3104992020,0cyclictest0-21swapper/200:38:512
3104992019,1cyclictest0-21swapper/220:03:482
3104992018,1cyclictest30903-21tune2fs23:28:512
3104992018,1cyclictest0-21swapper/223:13:472
3104992015,4cyclictest25604-21ntpq21:03:532
310499200,20cyclictest0-21swapper/222:58:482
310499200,0cyclictest6008-21apt-get19:18:462
310499200,0cyclictest0-21swapper/219:33:472
3102992020,0cyclictest0-21swapper/123:23:491
3102992020,0cyclictest0-21swapper/122:08:491
3102992020,0cyclictest0-21swapper/121:03:471
3102992020,0cyclictest0-21swapper/120:18:501
3102992018,1cyclictest16640-21apt-get21:53:491
3102992018,1cyclictest0-21swapper/121:10:001
310299200,20cyclictest0-21swapper/121:23:491
310299200,19cyclictest28100-21apt-get20:03:481
310299200,0cyclictest0-21swapper/121:48:481
3098992020,0cyclictest30394-21apt-get23:28:490
3098992020,0cyclictest11844-21apt-get21:43:470
3098992020,0cyclictest0-21swapper/023:43:480
3098992020,0cyclictest0-21swapper/022:23:490
3098992020,0cyclictest0-21swapper/020:23:440
3098992018,2cyclictest0-21swapper/020:48:480
309899200,20cyclictest0-21swapper/020:08:450
309899200,0cyclictest3514-21apt-get22:33:470
309899200,0cyclictest0-21swapper/023:13:470
3107991919,0cyclictest0-21swapper/322:23:493
3107991919,0cyclictest0-21swapper/320:28:483
3107991919,0cyclictest0-21swapper/319:58:483
3107991918,1cyclictest13222-21apt-get19:33:473
310799190,0cyclictest0-21swapper/321:33:483
3104991919,0cyclictest8330-21apt-get22:43:492
3104991919,0cyclictest14241-21apt-get21:48:482
3104991919,0cyclictest0-21swapper/223:53:492
3104991919,0cyclictest0-21swapper/222:28:482
3104991919,0cyclictest0-21swapper/222:08:482
3104991918,1cyclictest0-21swapper/219:58:532
3104991917,1cyclictest30397-21grep21:13:512
3104991917,1cyclictest27966-21smartctl00:28:532
3104991917,1cyclictest15952-21cstates19:38:472
3104991917,1cyclictest0-21swapper/223:58:572
3102991919,0cyclictest0-21swapper/123:08:481
3102991919,0cyclictest0-21swapper/122:28:481
3102991919,0cyclictest0-21swapper/121:28:501
3102991919,0cyclictest0-21swapper/119:28:491
3102991918,1cyclictest22098-21apt-get00:18:471
3102991918,0cyclictest20436-21apt-get19:48:451
310299190,0cyclictest0-21swapper/119:38:471
3098991919,0cyclictest25629-21apt-get19:58:480
3098991919,0cyclictest0-21swapper/022:13:480
3098991919,0cyclictest0-21swapper/000:08:480
3098991918,1cyclictest3683-21apt-get21:25:010
3098991912,6cyclictest19780-21idleruntime-cro23:05:000
309899190,7cyclictest27968-21acpi23:23:480
3107991818,0cyclictest19702-21apt-get00:13:493
3107991818,0cyclictest13123-21apt-get22:53:473
3107991818,0cyclictest0-21swapper/323:28:493
3107991818,0cyclictest0-21swapper/323:15:013
3107991818,0cyclictest0-21swapper/322:33:493
3107991818,0cyclictest0-21swapper/322:28:483
3107991818,0cyclictest0-21swapper/321:18:473
3107991818,0cyclictest0-21swapper/321:03:473
3107991818,0cyclictest0-21swapper/320:33:493
3107991816,1cyclictest29939-21cron20:05:003
310799180,17cyclictest0-21swapper/323:23:493
3104991818,0cyclictest431-21apt-get20:13:482
3104991818,0cyclictest0-21swapper/223:08:482
3104991818,0cyclictest0-21swapper/222:23:492
3104991818,0cyclictest0-21swapper/200:13:492
3104991817,1cyclictest0-21swapper/223:03:572
3104991817,1cyclictest0-21swapper/221:53:512
3104991817,1cyclictest0-21swapper/220:33:512
3104991816,1cyclictest0-21swapper/221:43:482
3104991815,2cyclictest19825-21/usr/sbin/munin21:58:512
3104991810,7cyclictest26515-21needreboot23:18:532
310499180,17cyclictest23936-21cron00:20:002
310499180,17cyclictest0-21swapper/220:28:482
3102991818,0cyclictest0-21swapper/122:58:471
3102991818,0cyclictest0-21swapper/122:18:451
3102991817,0cyclictest0-21swapper/100:13:491
3102991816,1cyclictest0-21swapper/120:40:001
3102991814,2cyclictest313-21systemd-journal20:25:011
3098991818,0cyclictest3609-21apt-get19:13:470
3098991818,0cyclictest26969-21apt-get21:08:480
3098991818,0cyclictest0-21swapper/023:53:490
3098991818,0cyclictest0-21swapper/020:43:470
3098991817,1cyclictest0-21swapper/000:38:510
3098991812,5cyclictest0-21swapper/021:03:500
309899180,0cyclictest0-21swapper/021:58:470
3107991717,0cyclictest0-21swapper/321:13:463
3107991717,0cyclictest0-21swapper/320:13:493
3107991717,0cyclictest0-21swapper/320:08:463
3107991716,0cyclictest0-21swapper/322:03:503
3104991717,0cyclictest0-21swapper/223:43:482
3104991717,0cyclictest0-21swapper/222:38:482
3104991717,0cyclictest0-21swapper/222:38:482
3104991717,0cyclictest0-21swapper/220:08:452
3104991717,0cyclictest0-21swapper/200:08:472
3102991717,0cyclictest0-21swapper/121:33:471
3102991717,0cyclictest0-21swapper/121:18:481
3102991717,0cyclictest0-21swapper/119:58:481
3102991717,0cyclictest0-21swapper/119:23:461
3102991715,1cyclictest0-21swapper/100:00:001
3098991717,0cyclictest0-21swapper/022:08:480
3098991717,0cyclictest0-21swapper/020:38:480
3098991714,2cyclictest0-21swapper/019:43:470
3098991712,5cyclictest0-21swapper/022:28:480
3107991616,0cyclictest29307-21apt-get00:33:473
3107991616,0cyclictest10005-21apt-get23:53:493
3107991616,0cyclictest0-21swapper/321:08:483
310799161,14cyclictest766-21snmpd19:48:463
3104991616,0cyclictest0-21swapper/220:48:482
3104991615,1cyclictest0-21swapper/219:13:472
3104991614,1cyclictest0-21swapper/223:48:572
3102991616,0cyclictest0-21swapper/120:43:471
3102991614,1cyclictest0-21swapper/122:48:461
3102991614,1cyclictest0-21swapper/100:25:001
3098991615,1cyclictest593-21dbus-daemon21:40:000
3098991614,1cyclictest31142-21dump-pmu-power00:35:000
309899160,16cyclictest0-21swapper/023:30:080
309899160,0cyclictest0-21swapper/019:50:010
310799153,11cyclictest22098-21apt-get00:18:473
3107991515,0cyclictest10827-21apt-get19:28:493
310799150,7cyclictest313-21systemd-journal23:49:563
310799150,1cyclictest9850-21diskstats21:38:483
310499159,6cyclictest0-21swapper/220:43:532
3104991515,0cyclictest0-21swapper/219:43:512
3104991514,1cyclictest612-21gdbus21:00:002
3104991512,3cyclictest0-21swapper/219:28:572
310499150,14cyclictest0-21swapper/223:37:252
3102991515,0cyclictest0-21swapper/123:48:481
3102991515,0cyclictest0-21swapper/122:38:481
3102991515,0cyclictest0-21swapper/122:38:481
3102991515,0cyclictest0-21swapper/119:50:001
310299150,1cyclictest0-21swapper/120:33:501
3098991515,0cyclictest15621-21apt-get19:38:460
3098991515,0cyclictest0-21swapper/000:28:470
3098991514,1cyclictest23292-21turbostat.cron22:05:010
3107991414,0cyclictest0-21swapper/321:43:473
310799140,14cyclictest0-21swapper/323:40:163
310799140,14cyclictest0-21swapper/323:13:173
310799140,14cyclictest0-21swapper/322:45:223
310799140,0cyclictest0-21swapper/323:03:003
310799140,0cyclictest0-21swapper/322:05:543
310799140,0cyclictest0-21swapper/319:20:113
310799140,0cyclictest0-21swapper/319:15:003
310499140,14cyclictest0-21swapper/220:51:432
310499140,14cyclictest0-21swapper/219:46:112
3102991414,0cyclictest0-21swapper/120:10:441
310299140,14cyclictest0-21swapper/123:51:301
310299140,14cyclictest0-21swapper/122:41:311
310299140,14cyclictest0-21swapper/120:50:171
310299140,14cyclictest0-21swapper/119:40:211
310299140,0cyclictest0-21swapper/123:36:231
310299140,0cyclictest0-21swapper/121:55:491
310299140,0cyclictest0-21swapper/121:40:201
3098991414,0cyclictest0-21swapper/020:15:490
309899140,14cyclictest0-21swapper/021:45:110
309899140,14cyclictest0-21swapper/020:50:430
3098991313,0cyclictest0-21swapper/000:03:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional