You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 02:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Mon Jun 22, 2026 00:43:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2265599646,50cyclictest149003-21ssh23:35:370
2265599646,50cyclictest149003-21ssh23:35:370
22657995244,5cyclictest31658-21awk19:40:012
2265799492,32cyclictest109098-21ssh22:30:362
22655994938,7cyclictest12650irq/32-eth022:40:330
22657994835,9cyclictest421-21dbus-daemon19:50:372
22655994836,6cyclictest55603-21kworker/u8:3-xprtiod21:10:320
22655994836,6cyclictest55603-21kworker/u8:3-xprtiod21:10:320
22655994726,14cyclictest12650irq/32-eth022:55:320
22657994535,7cyclictest2465353-21cups-browsed21:30:582
2265599453,37cyclictest152019-21ssh23:40:320
2265599453,37cyclictest152019-21ssh23:40:320
22657994335,5cyclictest92595-21ssh22:05:012
22655994337,4cyclictest151ktimers/019:25:340
22655994331,6cyclictest92444-21kworker/u8:2-rpciod22:07:160
22655994331,6cyclictest0-21swapper/021:00:300
22655994331,6cyclictest0-21swapper/021:00:300
22657994235,4cyclictest65403-21cpuspeed21:20:232
22657994234,5cyclictest163128-21ssh00:00:012
22657994233,6cyclictest420-21avahi-daemon23:25:432
22656994233,5cyclictest72493-21timerwakeupswit21:30:401
22656994233,5cyclictest0-21swapper/122:10:311
22655994233,6cyclictest2465330-21cupsd23:34:310
22655994230,8cyclictest12650irq/32-eth021:25:350
22657994130,8cyclictest115083-21missed_timers22:40:262
22655994132,6cyclictest2564995-21munin-node21:55:170
22655994131,6cyclictest0-21swapper/023:00:290
22655994114,19cyclictest421-21dbus-daemon22:25:360
22657994032,5cyclictest37627-21grep20:00:012
22657994032,5cyclictest135730-21grep23:15:012
2265699404,5cyclictest171rcu_preempt23:30:321
22656994033,4cyclictest141835-21sh23:25:011
22656994032,4cyclictest0-21swapper/122:55:311
22656994030,6cyclictest2465353-21cups-browsed23:05:171
22655994027,10cyclictest0-21swapper/020:35:010
2265599402,30cyclictest72146-21ssh21:30:330
2265599402,30cyclictest136714-21ssh23:15:270
22657993931,5cyclictest58634-21diskmemload21:10:242
22657993931,5cyclictest58634-21diskmemload21:10:242
22657993931,5cyclictest34523-21unixbench_multi19:45:412
22657993921,14cyclictest351ktimers/222:25:272
22656993930,5cyclictest75024-21missed_timers21:35:311
22655993934,3cyclictest163132-21cron00:00:000
22655993932,4cyclictest64824-21idleruntime-cro21:20:000
22655993929,7cyclictest2465353-21cups-browsed22:34:570
22655993926,10cyclictest90606-21ntp_offset22:00:320
22656993829,7cyclictest0-21swapper/121:40:351
22657993730,3cyclictest0-21swapper/221:00:302
22657993730,3cyclictest0-21swapper/221:00:302
22656993729,5cyclictest36128-21cron19:55:011
22655993732,3cyclictest151ktimers/000:25:310
22655993730,4cyclictest41165-21fschecks_time20:10:220
22655993728,6cyclictest421-21dbus-daemon22:38:370
22655993721,13cyclictest694-21cron20:55:010
22657993629,4cyclictest187427-21ssh00:40:012
22657993628,4cyclictest0-21swapper/220:35:332
22656993629,4cyclictest175251-21munin-plugin-st00:20:011
22656993623,6cyclictest0-21swapper/122:45:371
2265599368,10cyclictest14-21ksoftirqd/023:55:010
2265599368,10cyclictest14-21ksoftirqd/023:55:010
22655993627,6cyclictest420-21avahi-daemon21:49:350
22655993626,6cyclictest12650irq/32-eth023:05:310
22655993625,8cyclictest172265-21cron00:15:010
22655993616,15cyclictest76697-21kworker/u8:3+rpciod00:00:360
2265599361,3cyclictest0-21swapper/000:05:330
22657993528,4cyclictest1001-21mta-sts-daemon22:56:532
22657993527,5cyclictest114375-21latency_hist22:40:032
22656993529,3cyclictest0-21swapper/100:00:001
22656993528,4cyclictest1-21systemd19:35:011
22656993525,7cyclictest1-21systemd19:10:011
22656993525,4cyclictest0-21swapper/120:45:271
22656993523,5cyclictest1002-21mta-sts-daemon22:00:401
2265599354,14cyclictest14-21ksoftirqd/021:35:330
22655993528,4cyclictest45220-21latency_hist20:25:020
22655993526,6cyclictest2465353-21cups-browsed22:50:000
22655993526,6cyclictest120695-21aten2.4-expect22:50:200
22655993523,9cyclictest35148-21fschecks_count19:50:270
22657993426,5cyclictest58635-21munin-run21:10:002
22657993426,5cyclictest58635-21munin-run21:10:002
22657993425,5cyclictest122488-21kworker/u8:5+xprtiod23:40:012
22657993425,5cyclictest122488-21kworker/u8:5+xprtiod23:40:012
2265799341,23cyclictest62838-21ssh21:15:342
22656993428,4cyclictest150958-21ssh23:40:011
22656993428,4cyclictest150958-21ssh23:40:011
22656993428,3cyclictest0-21swapper/121:20:001
22656993428,3cyclictest0-21swapper/100:40:011
22656993426,5cyclictest114147-21cron22:40:011
22656993424,7cyclictest108746-21if_wlan022:30:281
22656993424,7cyclictest1002-21mta-sts-daemon21:10:341
22656993424,7cyclictest1002-21mta-sts-daemon21:10:341
22656993423,9cyclictest65739-21missed_timers21:20:301
2265699342,28cyclictest179390-21ssh00:25:321
2265599343,23cyclictest102891-21ssh22:20:290
22655993426,5cyclictest2465353-21cups-browsed22:18:490
22655993426,5cyclictest144915-21latency_hist23:30:020
22655993424,5cyclictest58659-21systemd-run21:10:010
22655993424,5cyclictest58659-21systemd-run21:10:010
2265599342,26cyclictest265-21systemd-journal19:15:310
22655993412,4cyclictest191rcuc/020:00:010
22657993328,2cyclictest0-21swapper/223:50:382
22657993328,2cyclictest0-21swapper/223:50:382
22657993328,2cyclictest0-21swapper/223:20:282
22657993326,5cyclictest1000-21mta-sts-daemon22:52:502
22657993326,4cyclictest1001-21mta-sts-daemon20:00:372
22657993326,4cyclictest1001-21mta-sts-daemon20:00:372
22657993326,3cyclictest0-21swapper/219:20:402
22657993325,5cyclictest75726-21unixbench_multi21:35:522
22657993325,5cyclictest130229-21fschecks_count23:05:242
22657993325,5cyclictest1000-21mta-sts-daemon20:15:302
22657993325,5cyclictest0-21swapper/221:30:012
22657993325,4cyclictest0-21swapper/220:05:292
22657993323,8cyclictest47444-21needreboot20:30:282
22656993327,3cyclictest0-21swapper/120:30:011
22656993326,3cyclictest0-21swapper/123:25:241
22656993325,5cyclictest151358-21head23:40:201
22656993325,5cyclictest151358-21head23:40:201
2265699331,26cyclictest115289-21ssh22:40:331
22655993326,4cyclictest33299-21latency_hist19:45:020
22655993326,4cyclictest0-21swapper/023:45:260
22655993320,9cyclictest12650irq/32-eth019:20:400
22655993318,10cyclictest0-21swapper/021:40:360
22657993226,3cyclictest0-21swapper/223:20:012
22657993226,3cyclictest0-21swapper/221:40:312
22657993225,3cyclictest0-21swapper/223:45:012
22657993225,3cyclictest0-21swapper/223:45:012
22657993224,5cyclictest104940-21cron22:25:012
22657993224,3cyclictest0-21swapper/222:47:032
22657993222,7cyclictest566-21gmain22:15:382
22657993222,4cyclictest0-21swapper/200:22:112
22656993226,3cyclictest0-21swapper/122:20:011
22656993226,3cyclictest0-21swapper/121:10:001
22656993226,3cyclictest0-21swapper/121:10:001
22656993226,3cyclictest0-21swapper/120:00:011
22656993225,4cyclictest89512-21sendmail22:00:011
22656993225,4cyclictest170886-21unixbench_singl00:10:461
22656993224,5cyclictest85005-21unixbench_singl21:50:461
22655993228,2cyclictest0-21swapper/020:35:290
22655993225,4cyclictest43506-21tail20:15:390
22655993219,8cyclictest12650irq/32-eth022:10:310
22655993213,3cyclictest171rcu_preempt00:33:210
22657993125,3cyclictest0-21swapper/221:55:012
22657993124,4cyclictest1001-21mta-sts-daemon00:33:532
22657993124,3cyclictest0-21swapper/200:25:332
2265799312,23cyclictest53578-21sshd20:50:322
2265799311,8cyclictest171rcu_preempt22:10:282
22657993115,9cyclictest2465353-21cups-browsed19:33:312
22656993124,4cyclictest49617-21cron20:40:011
22656993124,3cyclictest0-21swapper/100:05:011
22656993123,5cyclictest120955-21ssh22:50:231
22655993127,2cyclictest0-21swapper/020:00:410
22655993127,2cyclictest0-21swapper/020:00:410
22655993124,4cyclictest151ktimers/000:15:340
22655993122,6cyclictest31041-21sshd19:35:310
22655993119,8cyclictest12650irq/32-eth023:20:420
22655993119,2cyclictest171rcu_preempt19:30:240
22655993117,10cyclictest138858-21kworker/u8:1-xprtiod00:35:320
2265599311,24cyclictest176314-21ssh00:20:300
2265599311,10cyclictest14-21ksoftirqd/019:45:290
22657993024,3cyclictest0-21swapper/223:00:262
22657993022,5cyclictest81388-21ssh21:45:342
22657993022,4cyclictest175251-21munin-run00:20:012
22656993022,5cyclictest24154-21systemd-run19:15:011
2265699302,22cyclictest176351-21ssh00:20:311
22656993021,6cyclictest154566-21cpuspeed23:45:211
22656993021,6cyclictest0-21swapper/122:25:021
2265599307,20cyclictest151ktimers/021:20:300
22655993024,4cyclictest134267-21unixbench_singl23:10:410
22655993021,6cyclictest151ktimers/020:45:260
22655993018,6cyclictest171rcu_preempt20:45:020
2265799294,16cyclictest428-21mta-sts-daemon22:05:292
22657992922,4cyclictest32702-21processes19:40:362
2265799292,21cyclictest164241-21ssh00:00:352
22657992921,5cyclictest52516-21unixbench_multi20:45:372
22657992921,4cyclictest0-21swapper/200:10:342
22657992919,7cyclictest154797-21latency23:45:252
22656992923,3cyclictest0-21swapper/120:50:321
22656992922,5cyclictest105809-21missed_timers22:25:251
2265699292,20cyclictest68989-21ssh21:25:321
22656992919,7cyclictest420-21avahi-daemon22:09:281
2265599294,9cyclictest14-21ksoftirqd/021:50:380
22655992914,2cyclictest171rcu_preempt20:25:320
2265799283,18cyclictest421-21dbus-daemon23:30:292
22657992821,4cyclictest25644-21awk19:20:012
22657992818,7cyclictest50819-21switchtime20:40:382
22656992823,2cyclictest0-21swapper/100:35:011
22656992822,3cyclictest0-21swapper/120:25:011
22656992822,3cyclictest0-21swapper/120:20:011
22656992820,5cyclictest55628-21awk21:00:001
22656992820,5cyclictest55628-21awk21:00:001
22656992820,4cyclictest3741263-21kworker/u8:20-xprtiod20:12:271
2265699281,18cyclictest133756-21ssh23:10:321
22655992811,3cyclictest0-21swapper/019:10:350
22657992714,3cyclictest171rcu_preempt19:10:352
2265699277,9cyclictest428-21mta-sts-daemon19:35:321
22656992721,3cyclictest271ktimers/123:15:311
22656992721,3cyclictest0-21swapper/123:50:261
22656992721,3cyclictest0-21swapper/123:50:261
22656992720,4cyclictest34052-21ntpq19:45:311
22656992720,4cyclictest1001-21mta-sts-daemon23:00:281
22656992719,5cyclictest25513-21unixbench_multi19:15:411
2265599279,2cyclictest171rcu_preempt20:05:320
22657992620,4cyclictest22654-21cyclictest00:05:242
22657992620,3cyclictest0-21swapper/220:10:402
22657992617,6cyclictest1000-21mta-sts-daemon20:55:282
22657992617,6cyclictest1000-21mta-sts-daemon20:55:282
22657992617,5cyclictest89551-21ssh22:00:022
22656992619,4cyclictest265-21systemd-journal00:06:011
22656992619,3cyclictest0-21swapper/120:45:011
22656992618,5cyclictest48055-21unixbench_singl20:30:421
22656992618,5cyclictest39109-21run-parts20:01:001
22656992618,5cyclictest39109-21run-parts20:01:001
22656992615,7cyclictest80647-21cut21:45:201
22657992515,7cyclictest27399-21cut19:25:182
2265799251,20cyclictest44528-21ntpq20:20:322
22655992519,3cyclictest151ktimers/020:55:190
22655992519,3cyclictest151ktimers/020:55:190
22655992515,8cyclictest0-21swapper/019:10:020
22656992414,7cyclictest420-21avahi-daemon19:30:021
22657992317,3cyclictest0-21swapper/219:10:022
22657992316,5cyclictest45370-21/usr/sbin/munin20:25:262
22656992317,3cyclictest0-21swapper/119:40:351
22656992214,6cyclictest485-21in:imuxsock21:01:001
22656992214,6cyclictest485-21in:imuxsock21:01:001
22656992212,6cyclictest420-21avahi-daemon19:20:291
2265899191,9cyclictest0-21swapper/322:35:313
2265899191,10cyclictest0-21swapper/323:40:293
2265899191,10cyclictest0-21swapper/323:40:293
2265699191,13cyclictest40022-21ntpq20:05:301
2265899182,8cyclictest0-21swapper/322:25:313
2265899173,7cyclictest0-21swapper/321:50:313
2265899171,8cyclictest0-21swapper/323:50:353
2265899171,8cyclictest0-21swapper/323:50:353
2265899171,8cyclictest0-21swapper/322:30:383
2265899171,7cyclictest0-21swapper/319:10:393
2265899162,8cyclictest0-21swapper/322:40:223
2265899162,8cyclictest0-21swapper/322:10:363
2265899162,7cyclictest0-21swapper/323:15:293
2265899162,6cyclictest0-21swapper/320:45:253
2265899162,6cyclictest0-21swapper/320:35:273
2265899162,5cyclictest0-21swapper/319:35:283
2265899161,7cyclictest0-21swapper/320:50:283
2265899161,6cyclictest0-21swapper/322:05:273
2265899154,6cyclictest0-21swapper/300:10:363
2265899152,8cyclictest0-21swapper/322:55:223
2265899152,8cyclictest0-21swapper/320:25:023
2265899152,7cyclictest0-21swapper/321:10:313
2265899152,7cyclictest0-21swapper/321:10:313
2265899151,8cyclictest0-21swapper/322:00:323
2265899151,7cyclictest0-21swapper/321:30:293
2265899151,7cyclictest0-21swapper/300:25:313
2265899151,6cyclictest0-21swapper/320:55:293
2265899151,6cyclictest0-21swapper/320:55:293
2265899151,6cyclictest0-21swapper/319:40:343
2265899145,5cyclictest0-21swapper/323:05:393
2265899143,7cyclictest0-21swapper/321:40:403
2265899142,8cyclictest0-21swapper/323:30:423
2265899142,8cyclictest0-21swapper/321:00:303
2265899142,8cyclictest0-21swapper/321:00:303
2265899142,8cyclictest0-21swapper/300:16:093
2265899142,7cyclictest0-21swapper/323:25:293
2265899142,7cyclictest0-21swapper/323:10:313
2265899142,7cyclictest0-21swapper/321:25:303
2265899142,7cyclictest0-21swapper/300:05:263
2265899142,6cyclictest0-21swapper/321:35:343
2265899142,6cyclictest0-21swapper/319:55:313
2265899142,5cyclictest0-21swapper/320:30:303
2265899142,5cyclictest0-21swapper/320:05:283
2265899142,5cyclictest0-21swapper/319:50:333
2265899141,8cyclictest0-21swapper/321:15:293
2265899141,8cyclictest0-21swapper/300:35:253
2265899141,7cyclictest0-21swapper/319:45:293
2265899141,7cyclictest0-21swapper/319:20:403
2265899141,6cyclictest0-21swapper/319:25:343
2265899133,5cyclictest0-21swapper/322:50:323
2265899131,8cyclictest0-21swapper/323:20:283
2265899131,8cyclictest0-21swapper/320:10:323
2265899131,7cyclictest0-21swapper/322:20:273
2265899131,7cyclictest0-21swapper/320:15:323
2265899131,6cyclictest0-21swapper/323:45:203
2265899131,6cyclictest0-21swapper/320:00:323
2265899131,6cyclictest0-21swapper/320:00:323
2265899131,5cyclictest0-21swapper/319:30:283
2265899123,7cyclictest0-21swapper/323:35:273
2265899123,7cyclictest0-21swapper/323:35:273
2265899122,6cyclictest0-21swapper/323:00:203
2265899122,6cyclictest0-21swapper/322:45:283
2265899122,6cyclictest0-21swapper/321:45:193
2265899122,6cyclictest0-21swapper/300:30:193
2265899121,8cyclictest0-21swapper/321:20:203
2265899121,7cyclictest0-21swapper/323:55:203
2265899121,7cyclictest0-21swapper/300:00:263
2265899121,6cyclictest0-21swapper/321:05:313
2265899121,6cyclictest0-21swapper/321:05:313
2265899121,6cyclictest0-21swapper/320:40:293
2265899121,6cyclictest0-21swapper/320:25:323
2265899114,5cyclictest0-21swapper/300:20:313
2265899112,5cyclictest0-21swapper/319:15:313
2265899111,7cyclictest0-21swapper/322:15:203
2265899111,6cyclictest0-21swapper/321:55:183
226589981,5cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional