You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 03:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Wed Jul 01, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
230934995140,7cyclictest355993-21munin-run23:35:011
230934994739,5cyclictest248936-21systemd-run20:10:011
230935994636,6cyclictest267705-21kernelversion21:10:302
230935994636,6cyclictest267705-21kernelversion21:10:302
230935994634,8cyclictest1-21systemd23:10:022
230933994638,5cyclictest421-21dbus-daemon22:34:340
230933994538,5cyclictest371344-21idleruntime-cro00:00:010
230934994436,5cyclictest1003-21mta-sts-daemon22:35:391
230935994333,6cyclictest385550-21latency_hist00:25:022
230935994135,3cyclictest0-21swapper/200:20:012
230935994133,5cyclictest285473-21kworker/u8:7+xprtiod22:05:462
230935994129,9cyclictest389669-21ntp_states00:30:382
230934994134,4cyclictest0-21swapper/123:20:011
230934994132,6cyclictest394650-21ssh00:40:011
230934994132,6cyclictest394650-21ssh00:40:011
230935994032,5cyclictest343717-21cron23:15:002
230935993932,4cyclictest355985-21cron23:35:012
230935993932,4cyclictest1002-21mta-sts-daemon00:39:332
230935993932,4cyclictest1002-21mta-sts-daemon00:39:332
230935993930,5cyclictest328485-21latency_hist22:50:022
230935993929,7cyclictest371348-21idleruntime-cro00:00:012
230934993931,5cyclictest285450-21idleruntime-cro21:40:011
230934993931,5cyclictest245962-21latency_hist20:00:011
230934993930,6cyclictest1002-21mta-sts-daemon22:25:021
230933993933,4cyclictest377910-21grep00:10:420
230935993830,5cyclictest319519-21kworker/u8:0-xprtiod23:45:472
230933993830,5cyclictest420-21avahi-daemon22:23:340
230933993830,5cyclictest2679292-21cups-browsed22:29:040
230933993829,5cyclictest297683-21cron22:00:010
230933993825,10cyclictest0-21swapper/021:25:010
230935993729,5cyclictest266918-21diskmemload21:55:262
230935993728,6cyclictest317433-21mailstats22:30:422
230934993729,5cyclictest421-21dbus-daemon00:15:011
230933993731,4cyclictest421-21dbus-daemon20:25:010
230933993731,4cyclictest294637-21munin-run21:55:000
230933993730,5cyclictest421-21dbus-daemon22:15:010
230933993730,4cyclictest242938-21kworker/u8:3-rpciod21:10:350
230933993730,4cyclictest242938-21kworker/u8:3-rpciod21:10:350
230933993730,4cyclictest233940-21sendmail19:20:010
230933993729,5cyclictest371391-21cupsd00:31:250
230934993630,3cyclictest0-21swapper/100:00:011
230934993629,4cyclictest0-21swapper/100:20:011
230934993628,5cyclictest2679292-21cups-browsed21:53:291
230934993627,4cyclictest0-21swapper/123:50:331
230933993629,4cyclictest1002-21mta-sts-daemon21:37:350
230935993528,4cyclictest388538-21idleruntime-cro00:30:012
230935993527,5cyclictest270652-21ssh21:15:272
230934993527,5cyclictest390132-21unixbench_multi00:30:461
230934993525,6cyclictest420-21avahi-daemon23:14:141
230933993528,4cyclictest270590-21cpuspeed21:15:250
230935993427,4cyclictest288525-21cut21:45:012
230935993427,4cyclictest288525-21cut21:45:012
230935993426,5cyclictest0-21swapper/222:40:002
230935993425,6cyclictest0-21swapper/222:25:472
230935993423,8cyclictest350378-21aten_r2power_vo23:25:242
230934993427,4cyclictest388650-21latency_hist00:30:031
230934993427,4cyclictest1000-21mta-sts-daemon23:25:051
230934993426,5cyclictest255439-21fschecks_count20:30:261
230934993426,5cyclictest255439-21fschecks_count20:30:261
230934993425,7cyclictest244066-21switchtime19:50:441
230934993425,7cyclictest244066-21switchtime19:50:441
230934993425,6cyclictest266918-21diskmemload21:20:271
230934993423,8cyclictest307795-21missed_timers22:15:281
230933993428,4cyclictest394656-21idleruntime-cro00:40:010
230933993428,4cyclictest394656-21idleruntime-cro00:40:010
230933993426,4cyclictest0-21swapper/023:10:340
230933993424,8cyclictest388526-21ssh00:30:010
230933993423,8cyclictest0-21swapper/023:40:470
230933993421,11cyclictest354511-21grep23:30:480
230933993421,10cyclictest331911-21aten2.4-expect22:55:240
230933993419,13cyclictest323109-21latency22:40:340
230935993325,5cyclictest2679292-21cups-browsed22:15:512
230935993325,5cyclictest2679292-21cups-browsed19:38:462
230935993324,6cyclictest420-21avahi-daemon23:53:322
230934993328,3cyclictest233894-21kworker/u8:0-rpciod20:50:021
230934993328,3cyclictest233894-21kworker/u8:0-rpciod20:50:021
230934993326,4cyclictest306904-21idleruntime-cro22:15:011
230934993325,5cyclictest288912-21aten_r2power_cu21:45:241
230934993325,5cyclictest288912-21aten_r2power_cu21:45:241
230934993324,6cyclictest420-21avahi-daemon21:10:411
230934993324,6cyclictest420-21avahi-daemon21:10:411
230934993324,5cyclictest271592-21unixbench-2d21:15:461
230933993327,4cyclictest380008-21gltestperf00:15:280
230933993327,4cyclictest359054-21ssh23:40:010
230933993326,5cyclictest2679292-21cups-browsed20:35:320
230935993224,5cyclictest346777-21cron23:20:012
230935993224,5cyclictest233917-21idleruntime-cro19:20:012
230935993223,7cyclictest262087-21switchtime20:50:442
230935993223,5cyclictest376283-21systemd-run00:10:012
230934993226,4cyclictest326950-21unixbench_singl22:45:481
230934993225,4cyclictest230938-21systemd-run19:10:011
230933993226,4cyclictest303848-21munin-plugin-st22:10:010
230933993226,4cyclictest239906-21cron19:40:000
230933993226,4cyclictest238493-21latency_hist19:35:020
230935993124,4cyclictest280928-21unixbench_singl21:30:462
230935993124,4cyclictest259441-21systemd-run20:45:012
230935993124,3cyclictest0-21swapper/222:50:362
230935993123,5cyclictest1002-21mta-sts-daemon22:56:382
230935993122,7cyclictest235435-21/usr/sbin/munin19:25:022
230935993122,6cyclictest311410-21switchtime22:20:482
230934993125,3cyclictest0-21swapper/122:05:451
230934993125,3cyclictest0-21swapper/121:35:011
230934993123,5cyclictest421-21dbus-daemon21:25:241
230934993123,5cyclictest339111-21unixbench-2d23:05:451
230934993123,5cyclictest262401-21cron20:55:001
230934993122,6cyclictest420-21avahi-daemon22:25:571
230934993121,6cyclictest362136-21grep23:45:011
230933993126,3cyclictest366634-21timerandwakeup23:50:450
230933993125,4cyclictest320167-21needreboot22:35:370
230933993125,4cyclictest255788-21ntp_kernel_pll_20:30:330
230933993125,4cyclictest255788-21ntp_kernel_pll_20:30:330
230933993125,4cyclictest0-21swapper/023:15:420
230933993124,4cyclictest420-21avahi-daemon22:03:230
230935993024,3cyclictest0-21swapper/221:30:012
230935993022,5cyclictest282517-21ssh21:35:032
230935993022,5cyclictest276133-21ssh21:24:512
230935993021,6cyclictest420-21avahi-daemon23:01:012
230935993021,5cyclictest291585-21munin-plugin-st21:50:002
230935993021,5cyclictest291585-21munin-plugin-st21:50:002
230934993025,2cyclictest0-21swapper/119:20:011
230934993024,3cyclictest0-21swapper/100:05:011
230934993023,3cyclictest1003-21mta-sts-daemon00:21:311
230934993022,5cyclictest2679292-21cups-browsed22:30:321
230934993022,5cyclictest1002-21mta-sts-daemon22:40:401
230934993021,7cyclictest295415-21sh21:55:311
230934993020,8cyclictest251309-21ntp_kernel_pll_20:15:351
230934993020,7cyclictest363014-21latency23:45:311
230934993020,7cyclictest237734-21needreboot19:30:311
230934993020,3cyclictest266918-21diskmemload22:00:441
230933993025,3cyclictest0-21swapper/019:40:480
230933993024,3cyclictest0-21swapper/021:45:250
230933993024,3cyclictest0-21swapper/021:45:250
230935992924,2cyclictest0-21swapper/200:05:012
230935992923,3cyclictest0-21swapper/221:50:302
230935992923,3cyclictest0-21swapper/219:45:022
230935992923,3cyclictest0-21swapper/200:10:212
230935992922,5cyclictest0-21swapper/220:20:012
230935992922,2cyclictest0-21swapper/223:40:332
230935992921,5cyclictest420-21avahi-daemon23:21:132
230935992919,7cyclictest299092-21ls22:00:462
230935992914,11cyclictest323002-21if_wlan022:40:332
230934992923,4cyclictest1000-21mta-sts-daemon22:51:141
230934992922,4cyclictest265691-21aten_r2power_cu21:05:241
230934992922,4cyclictest0-21swapper/123:35:461
230934992921,5cyclictest236922-21cron19:30:001
230934992921,5cyclictest236922-21cron19:30:001
230934992919,3cyclictest266918-21diskmemload22:55:371
230933992924,3cyclictest230956-21latency_hist19:10:020
230933992923,4cyclictest421-21dbus-daemon23:10:010
230933992923,4cyclictest288513-21cron21:45:010
230933992923,4cyclictest288513-21cron21:45:010
230933992923,4cyclictest2679292-21cups-browsed21:28:310
230933992923,4cyclictest2679292-21cups-browsed20:05:370
230933992923,4cyclictest265358-21unixbench_singl21:00:460
230933992923,3cyclictest0-21swapper/020:00:000
230933992922,5cyclictest235423-21cron19:25:010
230935992822,3cyclictest427-21polkitd22:14:342
230935992821,3cyclictest0-21swapper/221:00:362
23093499284,19cyclictest627-21lldpd21:00:371
230934992822,3cyclictest0-21swapper/100:10:011
230934992821,4cyclictest1003-21mta-sts-daemon20:25:011
230934992820,5cyclictest232439-21systemd-run19:15:011
230934992819,6cyclictest420-21avahi-daemon23:00:171
230933992824,2cyclictest0-21swapper/020:05:000
230933992824,2cyclictest0-21swapper/000:00:520
230933992823,2cyclictest0-21swapper/023:20:470
230933992821,5cyclictest265-21systemd-journal22:50:010
230933992821,4cyclictest362729-21cpuspeed23:45:260
230933992820,5cyclictest2679292-21cups-browsed23:28:440
230935992722,2cyclictest0-21swapper/220:40:002
230935992722,2cyclictest0-21swapper/219:10:012
230935992719,5cyclictest421-21dbus-daemon20:15:012
230935992719,5cyclictest421-21dbus-daemon20:15:012
230934992722,2cyclictest0-21swapper/120:40:001
230934992721,3cyclictest0-21swapper/121:40:231
230934992721,3cyclictest0-21swapper/121:40:231
230934992718,6cyclictest1002-21mta-sts-daemon19:23:331
230934992716,8cyclictest420-21avahi-daemon20:00:281
230934992715,9cyclictest254238-21needreboot20:25:301
230933992722,3cyclictest0-21swapper/023:00:390
230933992721,4cyclictest383645-21proc_pri00:20:430
230933992721,4cyclictest2679292-21cups-browsed21:34:120
230933992719,6cyclictest251082-21latency20:15:280
230933992719,5cyclictest257945-21kworker/u8:11-xprtiod20:45:470
230933992719,5cyclictest257945-21kworker/u8:11-xprtiod20:45:470
230933992714,10cyclictest265-21systemd-journal20:28:210
230935992621,2cyclictest0-21swapper/221:00:002
230935992621,2cyclictest0-21swapper/220:30:242
230935992621,2cyclictest0-21swapper/220:30:242
230935992620,3cyclictest0-21swapper/223:37:002
230935992620,3cyclictest0-21swapper/220:00:002
230935992619,5cyclictest2679287-21cupsd20:26:222
230935992619,4cyclictest242936-21systemd-run19:50:012
230935992619,4cyclictest232287-21unixbench_multi19:10:452
230934992620,3cyclictest0-21swapper/119:35:441
230934992619,5cyclictest0-21swapper/123:20:451
23093399262,15cyclictest307940-21ntpq22:15:320
230933992621,3cyclictest235703-21aten_r2power_cu19:25:220
230933992621,3cyclictest235703-21aten_r2power_cu19:25:220
230933992620,3cyclictest151ktimers/000:10:010
230933992617,7cyclictest2679292-21cups-browsed19:52:220
230933992617,7cyclictest2679292-21cups-browsed19:52:220
23093399261,19cyclictest231944-21ps19:10:400
230935992518,4cyclictest265935-21fschecks_count21:05:282
230934992518,4cyclictest242840-21unixbench_singl19:45:451
230934992518,4cyclictest241409-21kworker/u8:15-xprtiod19:45:011
230934992517,6cyclictest249460-21gltestperf20:10:281
230934992517,6cyclictest249460-21gltestperf20:10:281
230934992517,5cyclictest262948-21gltestperf20:55:271
230933992518,5cyclictest2679287-21cupsd20:10:240
230933992518,5cyclictest2679287-21cupsd20:10:240
230933992515,8cyclictest0-21swapper/020:50:240
230933992510,12cyclictest665-21snmpd22:50:360
23093599249,9cyclictest351ktimers/220:05:362
230935992419,3cyclictest1000-21mta-sts-daemon20:45:302
230935992419,3cyclictest1000-21mta-sts-daemon20:45:302
230935992419,2cyclictest0-21swapper/220:20:472
230935992417,4cyclictest244418-21cut19:55:002
230935992417,4cyclictest244418-21cut19:55:002
230935992414,7cyclictest246789-21awk20:00:332
230934992418,3cyclictest0-21swapper/120:45:001
230933992419,3cyclictest241830-21aten_r2power_vo19:45:240
230933992417,5cyclictest0-21swapper/021:00:000
230935992316,4cyclictest0-21swapper/219:25:322
230935992316,4cyclictest0-21swapper/219:25:322
230933992319,2cyclictest0-21swapper/021:10:010
23093699217,5cyclictest0-21swapper/322:25:343
230935992113,6cyclictest237938-21proc_pri19:30:402
230933992016,3cyclictest230932-21cyclictest20:40:320
23093699197,5cyclictest0-21swapper/323:45:343
23093699187,5cyclictest0-21swapper/321:45:333
23093699187,5cyclictest0-21swapper/321:45:333
23093699187,5cyclictest0-21swapper/321:00:403
23093699187,4cyclictest0-21swapper/323:40:333
23093699186,6cyclictest0-21swapper/322:45:213
23093699178,5cyclictest0-21swapper/300:30:383
23093699177,5cyclictest0-21swapper/322:10:323
23093699177,5cyclictest0-21swapper/320:25:383
23093699176,7cyclictest0-21swapper/300:15:393
23093699169,4cyclictest0-21swapper/321:25:333
23093699168,5cyclictest0-21swapper/319:40:323
23093699168,5cyclictest0-21swapper/300:00:353
23093699168,4cyclictest0-21swapper/323:55:363
23093699168,4cyclictest0-21swapper/323:35:343
23093699168,4cyclictest0-21swapper/323:10:393
23093699168,4cyclictest0-21swapper/322:20:353
23093699168,4cyclictest0-21swapper/322:15:313
23093699168,4cyclictest0-21swapper/321:50:423
23093699168,4cyclictest0-21swapper/321:10:373
23093699168,4cyclictest0-21swapper/321:10:373
23093699168,4cyclictest0-21swapper/320:30:393
23093699168,4cyclictest0-21swapper/320:30:393
23093699168,4cyclictest0-21swapper/320:05:353
23093699168,4cyclictest0-21swapper/319:10:343
23093699167,5cyclictest0-21swapper/323:25:383
23093699167,4cyclictest0-21swapper/320:40:353
23093699167,4cyclictest0-21swapper/320:10:373
23093699167,4cyclictest0-21swapper/320:10:373
23093699166,5cyclictest0-21swapper/300:35:353
23093699166,5cyclictest0-21swapper/300:35:353
23093699162,8cyclictest0-21swapper/323:15:473
23093699162,8cyclictest0-21swapper/321:30:383
23093699162,7cyclictest0-21swapper/320:45:373
23093699162,7cyclictest0-21swapper/320:45:373
23093699159,4cyclictest0-21swapper/322:55:323
23093699159,4cyclictest0-21swapper/322:40:383
23093699158,4cyclictest0-21swapper/323:05:353
23093699158,4cyclictest0-21swapper/323:00:413
23093699158,4cyclictest0-21swapper/322:35:403
23093699158,4cyclictest0-21swapper/320:35:323
23093699158,4cyclictest0-21swapper/300:10:343
23093699157,5cyclictest0-21swapper/321:40:393
23093699157,5cyclictest0-21swapper/321:40:393
23093699157,4cyclictest0-21swapper/323:50:343
23093699157,4cyclictest0-21swapper/321:35:333
23093699157,4cyclictest0-21swapper/321:05:353
23093699157,4cyclictest0-21swapper/320:20:333
23093699157,4cyclictest0-21swapper/320:15:333
23093699157,4cyclictest0-21swapper/319:55:353
23093699157,4cyclictest0-21swapper/319:50:343
23093699157,4cyclictest0-21swapper/319:50:343
23093699157,4cyclictest0-21swapper/319:30:323
23093699157,4cyclictest0-21swapper/300:20:303
23093699156,5cyclictest0-21swapper/322:50:273
23093699156,5cyclictest0-21swapper/319:45:333
23093699156,5cyclictest0-21swapper/300:25:203
23093699151,8cyclictest0-21swapper/319:10:023
23093699151,7cyclictest0-21swapper/322:05:363
23093699148,4cyclictest0-21swapper/322:30:333
23093699148,4cyclictest0-21swapper/320:50:323
23093699148,3cyclictest0-21swapper/323:20:363
23093699147,4cyclictest0-21swapper/322:00:343
23093699147,4cyclictest0-21swapper/321:20:333
23093699147,4cyclictest0-21swapper/320:55:323
23093699147,4cyclictest0-21swapper/319:25:313
23093699147,4cyclictest0-21swapper/319:25:313
23093699147,4cyclictest0-21swapper/319:15:323
23093699147,3cyclictest0-21swapper/300:05:083
23093699146,5cyclictest0-21swapper/323:30:333
23093699146,5cyclictest0-21swapper/320:00:233
23093699146,4cyclictest0-21swapper/321:55:063
23093699146,4cyclictest0-21swapper/321:15:043
23093699141,6cyclictest0-21swapper/319:20:343
23093699137,4cyclictest0-21swapper/319:35:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional