You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 09:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Thu Jul 30, 2026 00:43:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249418995443,7cyclictest421-21dbus-daemon00:25:582
24941699536,21cyclictest341928-21ssh22:40:560
249416995336,13cyclictest1-21systemd00:20:020
249418995142,5cyclictest259910-21grep19:45:012
249417995136,9cyclictest323414-21sh22:10:481
249417995136,9cyclictest323414-21sh22:10:481
249418994838,6cyclictest291593-21munin-run21:20:002
249416994839,3cyclictest0-21swapper/023:55:020
249418994737,6cyclictest265-21systemd-journal23:05:012
24941799454,30cyclictest350953-21ssh22:55:531
24941699456,35cyclictest750-21ntpd21:00:470
24941699451,20cyclictest320351-21ld22:05:470
24941699442,16cyclictest292705-21rm21:20:470
249416994417,4cyclictest306357-21ssh21:43:030
249416994321,3cyclictest0-21swapper/000:00:440
249418994233,5cyclictest389612-21sendmail-msp00:00:002
24941699426,10cyclictest12650irq/32-eth022:55:520
24941699425,9cyclictest428-21mta-sts-daemon19:25:460
249416994234,5cyclictest331503-21latency_hist22:25:020
249416994234,4cyclictest1002-21mta-sts-daemon23:47:080
249416994233,6cyclictest389646-21cups-browsed00:09:120
24941699422,18cyclictest357158-21sh23:05:520
24941699422,18cyclictest357158-21sh23:05:520
249416994219,3cyclictest316184-21kworker/u8:2-rpciod22:00:530
249416994218,5cyclictest301638-21ssh21:35:410
249418994134,3cyclictest0-21swapper/220:35:012
24941799413,6cyclictest171rcu_preempt23:05:551
24941799413,6cyclictest171rcu_preempt23:05:551
249417994133,5cyclictest271922-21cut20:25:011
249417994132,5cyclictest285408-21diskmemload23:15:011
249416994117,2cyclictest0-21swapper/000:40:010
249416994116,3cyclictest0-21swapper/019:55:010
24941699411,15cyclictest281842-21ntpq20:55:500
249416994110,9cyclictest265-21systemd-journal23:56:140
249418994032,5cyclictest253919-21munin-run19:25:002
249418994032,5cyclictest253919-21munin-run19:25:002
249418994030,6cyclictest420-21avahi-daemon22:03:282
249416994032,5cyclictest360348-21sendmail_mailst23:10:560
249416994031,6cyclictest420-21avahi-daemon00:14:530
249416994020,4cyclictest1001-21mta-sts-daemon00:33:040
249416994018,20cyclictest12750irq/33-eth022:15:500
24941699400,17cyclictest298196-21aten_r2power_cu21:30:380
24941899395,25cyclictest357041-21ssh23:05:482
24941899395,25cyclictest357041-21ssh23:05:482
249418993931,5cyclictest308629-21sed21:46:012
249418993931,4cyclictest386519-21cut23:55:012
249418993930,5cyclictest271921-21grep20:25:012
249418993928,7cyclictest420-21avahi-daemon23:26:162
249418993928,7cyclictest393357-21cpuspeed00:05:432
24941899392,31cyclictest332696-21ssh22:25:522
249417993933,3cyclictest0-21swapper/120:00:011
249417993931,5cyclictest0-21swapper/123:35:011
24941799392,29cyclictest329604-21ssh22:20:511
249416993927,9cyclictest332347-21kernelversion22:25:430
249418993831,5cyclictest0-21swapper/221:25:022
249418993830,5cyclictest250972-21latency_hist19:15:022
249418993830,5cyclictest250972-21latency_hist19:15:022
249418993828,7cyclictest401845-21munin-run00:20:012
249418993825,8cyclictest1-21systemd23:45:012
249418993823,12cyclictest421-21dbus-daemon21:25:532
249417993831,4cyclictest363741-21unixbench_multi23:15:581
249417993831,4cyclictest300864-21latency_hist21:35:021
249417993829,4cyclictest0-21swapper/121:35:361
249417993826,9cyclictest317706-21timerandwakeup22:00:591
24941699382,9cyclictest347578-21if_eth022:50:460
249416993817,6cyclictest335691-21ntpq22:30:500
249416993816,5cyclictest378829-21switchtime23:40:560
249416993815,6cyclictest366920-21sshd23:21:040
249418993728,5cyclictest316153-21cut22:00:012
249417993730,4cyclictest3972462-21kworker/u8:1-rpciod21:30:011
249417993730,4cyclictest378060-21ssh23:40:381
249417993730,4cyclictest306988-21cron21:45:011
249417993729,4cyclictest0-21swapper/122:50:011
249417993728,6cyclictest2728660-21cups-browsed22:30:381
249417993726,8cyclictest405460-21aten_r2power_po00:25:371
24941699373,27cyclictest338758-21ssh22:35:520
249416993729,4cyclictest151ktimers/019:10:520
249416993729,4cyclictest151ktimers/019:10:520
249416993717,18cyclictest319251-21kworker/u8:14-rpciod23:05:020
249418993628,5cyclictest285408-21diskmemload00:05:012
249418993626,6cyclictest1000-21mta-sts-daemon22:14:302
249418993626,6cyclictest1000-21mta-sts-daemon22:14:302
249417993630,3cyclictest0-21swapper/121:10:021
249417993628,5cyclictest280923-21systemd-run20:55:021
249417993627,5cyclictest332170-21/usr/sbin/munin22:25:411
24941799362,25cyclictest320341-21ssh22:05:461
249416993629,4cyclictest267430-21systemd-run20:10:010
249416993627,6cyclictest346772-21awk22:50:010
249416993622,4cyclictest285307-21unixbench_multi21:06:050
249416993613,17cyclictest323441-21ssh22:10:490
249416993613,17cyclictest323441-21ssh22:10:490
249418993524,8cyclictest341856-21ntp_offset22:40:532
249417993528,4cyclictest0-21swapper/122:20:001
24941799351,6cyclictest171rcu_preempt21:45:561
24941699353,15cyclictest1000-21mta-sts-daemon21:50:440
249416993527,5cyclictest2728660-21cups-browsed21:48:370
249418993427,4cyclictest694-21cron23:35:012
249418993427,4cyclictest255439-21wc19:30:012
249418993426,5cyclictest382057-21sed23:45:592
249418993426,5cyclictest303915-21sendmail21:40:012
249418993426,5cyclictest1-21systemd20:45:012
249418993426,5cyclictest1-21systemd20:45:012
249418993423,7cyclictest280894-21cron20:55:012
249417993427,3cyclictest0-21swapper/100:35:481
249417993426,5cyclictest421-21dbus-daemon22:55:021
249417993426,5cyclictest371238-21munin-plugin-st23:30:011
249417993425,6cyclictest421-21dbus-daemon00:14:531
249417993425,6cyclictest313114-21systemd-run21:55:011
249417993425,5cyclictest267430-21systemd-run20:10:011
249417993424,7cyclictest1002-21mta-sts-daemon00:33:531
249416993427,4cyclictest12650irq/32-eth020:45:520
249416993426,5cyclictest273431-21systemd-run20:30:010
249416993422,9cyclictest259841-21unixbench_singl19:41:030
249416993414,2cyclictest0-21swapper/020:25:020
24941699341,27cyclictest289740-21rm21:15:520
249418993326,3cyclictest0-21swapper/221:34:032
249418993325,5cyclictest421-21dbus-daemon21:15:022
249418993325,5cyclictest338330-21ssh22:35:432
249418993325,5cyclictest1-21systemd21:05:012
249418993325,4cyclictest362058-21munin-plugin-st23:15:002
249418993321,8cyclictest264403-21idleruntime-cro20:00:012
249417993326,4cyclictest402612-21gltestperf00:20:421
249417993326,4cyclictest402612-21gltestperf00:20:421
249417993326,3cyclictest0-21swapper/122:40:401
249417993325,5cyclictest382057-21unixbench-2d23:45:591
249417993325,5cyclictest255351-21unixbench_singl19:25:591
249417993324,6cyclictest567-21gdbus19:10:561
249417993324,6cyclictest567-21gdbus19:10:561
24941699332,12cyclictest665-21snmpd21:10:560
249418993225,3cyclictest0-21swapper/222:20:212
249418993225,3cyclictest0-21swapper/200:31:032
249418993224,5cyclictest269235-21aten_r2power_fr20:15:382
249418993223,6cyclictest320522-21proc_pri22:05:542
249417993226,3cyclictest0-21swapper/121:15:031
249417993225,4cyclictest353943-21needreboot23:00:481
249417993224,5cyclictest388279-21grep23:56:031
249417993224,5cyclictest368188-21cron23:25:011
249417993222,8cyclictest390828-21sh00:00:551
24941799322,23cyclictest314252-21ssh21:55:501
249417993221,4cyclictest0-21swapper/100:05:581
249416993223,6cyclictest295098-21/usr/sbin/munin21:25:440
249418993125,3cyclictest0-21swapper/223:00:022
249418993124,3cyclictest337599-21kworker/u8:16-events_unbound23:35:382
249418993123,5cyclictest414111-21sendmail00:40:012
249418993123,5cyclictest0-21swapper/220:05:022
249418993123,4cyclictest284183-21aten_r2power_cu21:05:392
249418993122,5cyclictest366795-21unixbench-2d23:21:002
249418993120,8cyclictest311624-21timerwakeupswit21:50:562
249417993124,4cyclictest293303-21unixbench_multi21:21:001
249417993123,5cyclictest270395-21cron20:20:011
249417993123,5cyclictest257433-21fschecks_time19:35:421
249417993119,8cyclictest1-21systemd20:05:021
249416993124,5cyclictest375799-21xargs23:36:010
249418993023,4cyclictest334926-21/usr/sbin/munin22:30:402
249418993022,5cyclictest396792-21needreboot00:10:462
249418993022,5cyclictest2728660-21cups-browsed23:19:392
249418993014,12cyclictest351ktimers/219:50:522
249417993025,2cyclictest0-21swapper/100:15:431
249417993021,6cyclictest1000-21mta-sts-daemon21:19:301
249416993025,3cyclictest371238-21grep23:30:010
249416993024,4cyclictest0-21swapper/020:15:500
249416993022,6cyclictest362786-21fschecks_time23:15:390
24941699301,22cyclictest402962-21ssh00:20:480
24941699301,22cyclictest402962-21ssh00:20:480
249418992923,3cyclictest1000-21mta-sts-daemon19:30:422
249418992922,4cyclictest266376-21cpuspeed20:05:392
249418992922,4cyclictest0-21swapper/200:21:212
249418992922,4cyclictest0-21swapper/200:21:212
249418992921,5cyclictest0-21swapper/222:50:012
249417992923,3cyclictest0-21swapper/123:35:491
249417992922,4cyclictest1000-21mta-sts-daemon23:53:141
249417992920,6cyclictest567-21gdbus19:52:591
249417992920,6cyclictest282604-21latency_hist21:00:031
249417992919,6cyclictest265-21systemd-journal19:25:001
249417992919,6cyclictest265-21systemd-journal19:25:001
249417992918,5cyclictest271ktimers/120:40:561
249417992918,5cyclictest271ktimers/120:40:561
249417992917,9cyclictest271ktimers/120:30:531
249416992923,4cyclictest264400-21idleruntime-cro20:00:010
249416992921,6cyclictest694-21cron20:15:010
249416992921,5cyclictest372317-21ntp_kernel_err23:30:460
249416992913,12cyclictest1001-21mta-sts-daemon21:55:470
249418992822,3cyclictest0-21swapper/220:15:012
249418992821,4cyclictest427-21polkitd20:38:532
249418992820,5cyclictest420-21avahi-daemon19:40:012
249418992820,5cyclictest348478-21unixbench_multi22:51:042
249417992821,4cyclictest255945-21gltestperf19:30:411
249417992818,7cyclictest1000-21mta-sts-daemon20:10:481
249417992815,5cyclictest259902-21cron19:45:011
24941699282,21cyclictest665-21snmpd20:35:520
249416992820,6cyclictest428-21mta-sts-daemon19:25:020
249416992820,6cyclictest428-21mta-sts-daemon19:25:020
249418992720,3cyclictest0-21swapper/221:40:552
249418992719,5cyclictest328385-21ssh22:20:002
24941799272,7cyclictest338698-21ntpq22:35:491
249417992722,2cyclictest0-21swapper/119:20:001
249417992722,2cyclictest0-21swapper/119:20:001
249417992720,3cyclictest0-21swapper/119:45:491
249417992719,5cyclictest283908-21cron21:05:011
249418992617,6cyclictest260425-21fschecks_count19:45:402
249417992618,5cyclictest272933-21proc_pri20:25:541
249416992621,3cyclictest0-21swapper/020:50:410
249416992620,4cyclictest405979-21diskmemload00:25:450
249416992619,5cyclictest420-21avahi-daemon20:35:010
249418992519,3cyclictest0-21swapper/221:00:012
249418992518,3cyclictest0-21swapper/220:25:522
24941699253,16cyclictest665-21snmpd19:35:500
249416992519,3cyclictest265801-21unixbench_multi20:00:580
249416992516,6cyclictest420-21avahi-daemon19:30:550
249416992510,4cyclictest260206-21aten_r2power_en19:45:370
249418992417,2cyclictest0-21swapper/219:15:442
249418992417,2cyclictest0-21swapper/219:15:442
249418992416,5cyclictest1001-21mta-sts-daemon20:45:452
249417992413,7cyclictest279182-21/usr/sbin/munin20:45:591
249416992418,4cyclictest2728660-21cups-browsed19:19:340
249416992418,4cyclictest2728660-21cups-browsed19:19:340
249417992315,5cyclictest276278-21unixbench_multi20:36:011
249416992317,4cyclictest276944-21fschecks_time20:40:430
249416992317,4cyclictest276944-21fschecks_time20:40:430
249418992215,3cyclictest0-21swapper/219:10:022
24941799202,14cyclictest249370-21munin-run19:10:011
24941999172,7cyclictest0-21swapper/320:40:523
24941999172,7cyclictest0-21swapper/320:40:523
24941699174,9cyclictest2728660-21cups-browsed19:10:020
24941999163,6cyclictest0-21swapper/323:45:483
24941999161,7cyclictest0-21swapper/320:20:473
24941999161,6cyclictest0-21swapper/321:40:493
24941999152,8cyclictest0-21swapper/323:25:583
24941999152,7cyclictest0-21swapper/322:55:553
24941999152,6cyclictest0-21swapper/322:25:463
24941999152,6cyclictest0-21swapper/321:50:443
24941999152,6cyclictest0-21swapper/321:30:513
24941999152,6cyclictest0-21swapper/319:40:523
24941999152,6cyclictest0-21swapper/300:30:513
24941999152,6cyclictest0-21swapper/300:05:583
24941999151,7cyclictest0-21swapper/323:40:483
24941999151,7cyclictest0-21swapper/323:00:513
24941999151,6cyclictest0-21swapper/321:10:563
24941999151,6cyclictest0-21swapper/320:15:523
24941999151,5cyclictest0-21swapper/319:15:503
24941999151,5cyclictest0-21swapper/319:15:503
24941999143,6cyclictest0-21swapper/320:40:013
24941999142,7cyclictest0-21swapper/321:55:483
24941999142,7cyclictest0-21swapper/320:00:013
24941999141,8cyclictest0-21swapper/322:05:543
24941999141,7cyclictest0-21swapper/322:50:523
24941999141,7cyclictest0-21swapper/300:15:533
24941999141,6cyclictest0-21swapper/320:45:483
24941999141,5cyclictest0-21swapper/320:30:513
24941999141,5cyclictest0-21swapper/319:20:473
24941999141,5cyclictest0-21swapper/319:20:473
24941999141,5cyclictest0-21swapper/319:10:473
24941999141,5cyclictest0-21swapper/319:10:473
24941999133,5cyclictest0-21swapper/321:35:523
24941999132,7cyclictest0-21swapper/321:20:593
24941999132,7cyclictest0-21swapper/300:11:013
24941999132,6cyclictest0-21swapper/323:55:453
24941999132,6cyclictest0-21swapper/323:20:473
24941999132,5cyclictest0-21swapper/319:30:463
24941999131,8cyclictest0-21swapper/323:36:513
24941999131,8cyclictest0-21swapper/300:35:553
24941999131,7cyclictest0-21swapper/322:30:393
24941999131,7cyclictest0-21swapper/322:10:463
24941999131,7cyclictest0-21swapper/322:10:463
24941999131,7cyclictest0-21swapper/321:25:583
24941999131,6cyclictest0-21swapper/323:05:493
24941999131,6cyclictest0-21swapper/323:05:493
24941999131,6cyclictest0-21swapper/320:10:473
24941999131,6cyclictest0-21swapper/320:05:503
24941999131,6cyclictest0-21swapper/319:50:483
24941999124,6cyclictest0-21swapper/300:20:413
24941999124,6cyclictest0-21swapper/300:20:413
24941999123,5cyclictest0-21swapper/300:00:503
24941999122,6cyclictest0-21swapper/322:36:013
24941999122,5cyclictest0-21swapper/321:50:023
24941999122,5cyclictest0-21swapper/320:55:403
24941999122,4cyclictest0-21swapper/321:05:513
24941999121,7cyclictest0-21swapper/323:30:383
24941999121,7cyclictest0-21swapper/323:15:493
24941999121,6cyclictest0-21swapper/322:20:453
24941999121,6cyclictest0-21swapper/322:15:423
24941999121,6cyclictest0-21swapper/320:25:533
24941999121,6cyclictest0-21swapper/319:45:483
24941999121,6cyclictest0-21swapper/319:40:013
24941999121,5cyclictest0-21swapper/322:00:373
24941999114,5cyclictest0-21swapper/322:40:483
24941999112,6cyclictest0-21swapper/323:50:553
24941999112,5cyclictest0-21swapper/321:05:023
24941999112,4cyclictest0-21swapper/320:50:393
24941999111,7cyclictest0-21swapper/321:15:363
24941999111,6cyclictest0-21swapper/322:45:393
24941999111,6cyclictest0-21swapper/300:25:403
24941999103,5cyclictest0-21swapper/323:10:393
24941999101,5cyclictest0-21swapper/319:25:463
2494199991,5cyclictest0-21swapper/320:00:403
2494199981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional