You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 21:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Wed Apr 08, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3557992720,2cyclictest28950-21diskmemload10:19:053
355699270,26cyclictest0-21swapper/212:34:522
3557992620,2cyclictest26189-21sh11:12:483
355799260,22cyclictest23974-21sh12:12:573
3557992520,1cyclictest8652-21ssh11:25:373
355799250,2cyclictest24254-21sh10:08:073
355799250,21cyclictest12499-21ssh09:55:563
355799250,1cyclictest3182-21ssh11:20:463
355799250,1cyclictest28200-21ssh10:11:143
355799250,1cyclictest18460-21diskmemload10:02:083
3556992523,1cyclictest0-21swapper/210:22:172
355699250,1cyclictest22258-21ssh10:37:252
355199250,24cyclictest28950-21diskmemload10:21:100
355199250,24cyclictest0-21swapper/010:09:000
355199250,24cyclictest0-21swapper/009:50:130
3557992421,0cyclictest0-21swapper/311:43:543
3557992420,1cyclictest28950-21diskmemload10:22:103
3557992420,1cyclictest28950-21diskmemload09:20:243
355799240,24cyclictest0-21swapper/311:57:243
355799240,23cyclictest28950-21diskmemload12:29:263
355799240,1cyclictest28950-21diskmemload12:30:553
355799240,1cyclictest0-21swapper/311:51:213
3556992423,1cyclictest28950-21diskmemload09:53:372
3556992422,1cyclictest28950-21diskmemload12:13:252
3556992422,0cyclictest0-21swapper/210:58:052
3556992421,2cyclictest19919-21unixbench_multi10:34:142
355699240,23cyclictest28950-21diskmemload11:32:372
3552992421,2cyclictest607-21in:imuxsock08:25:001
3552992420,3cyclictest19054-21perf11:05:001
355299240,24cyclictest0-21swapper/112:11:231
355299240,24cyclictest0-21swapper/109:50:511
355299240,23cyclictest20497-21sh09:33:461
355299240,23cyclictest13844-21munin-plugin-st11:00:001
355299240,23cyclictest12297-21sh12:32:371
355299240,23cyclictest0-21swapper/110:35:351
3551992423,1cyclictest62550irq/127-eno109:59:050
3551992423,1cyclictest28950-21diskmemload11:42:020
3551992422,1cyclictest25320-21sleep07:55:000
3551992422,1cyclictest0-21swapper/012:28:580
3551992422,1cyclictest0-21swapper/010:35:010
355199240,23cyclictest0-21swapper/012:11:250
355199240,23cyclictest0-21swapper/012:00:500
3557992323,0cyclictest0-21swapper/311:07:343
3557992320,0cyclictest0-21swapper/312:05:083
355799230,2cyclictest26586-21munin-plugin-st09:05:013
355799230,23cyclictest0-21swapper/310:25:013
355799230,23cyclictest0-21swapper/309:51:053
355799230,23cyclictest0-21swapper/309:46:453
355799230,23cyclictest0-21swapper/309:41:333
355799230,22cyclictest29515-21sh11:46:103
355799230,22cyclictest28951-21ssh12:17:463
355799230,22cyclictest28295-21apt-get08:04:043
355799230,22cyclictest28295-21apt-get08:04:043
355799230,22cyclictest15829-21sh12:35:013
355799230,0cyclictest28950-21diskmemload11:36:153
355799230,0cyclictest0-21swapper/312:04:023
355799230,0cyclictest0-21swapper/310:48:223
355799230,0cyclictest0-21swapper/310:33:383
3556992323,0cyclictest0-21swapper/210:43:402
3556992323,0cyclictest0-21swapper/209:41:332
3556992322,1cyclictest7375-21ssh11:24:422
3556992322,1cyclictest28599-21kworker/u8:109:39:182
3556992322,1cyclictest28599-21kworker/u8:109:39:182
3556992321,1cyclictest9718-21perf08:30:002
3556992321,1cyclictest18923-21ssh09:31:102
3556992320,2cyclictest18177-21ssh10:01:442
355699230,2cyclictest5867-21sh12:26:172
355699230,23cyclictest0-21swapper/211:03:182
355699230,23cyclictest0-21swapper/210:05:132
355699230,22cyclictest30325-21ssh11:47:292
355699230,22cyclictest19619-21sh11:05:372
355699230,22cyclictest12237-21ssh12:00:412
355699230,22cyclictest11539-21cron12:00:012
355699230,22cyclictest11536-21ssh11:29:082
355699230,22cyclictest0-21swapper/208:24:052
355699230,1cyclictest27731-21munin-run08:00:012
355699230,0cyclictest0-21swapper/212:38:502
355699230,0cyclictest0-21swapper/212:05:132
355699230,0cyclictest0-21swapper/211:11:262
355699230,0cyclictest0-21swapper/210:15:362
355699230,0cyclictest0-21swapper/209:48:392
3552992323,0cyclictest28950-21diskmemload12:03:511
3552992323,0cyclictest28950-21diskmemload10:26:171
3552992323,0cyclictest0-21swapper/112:22:021
3552992323,0cyclictest0-21swapper/111:47:571
3552992323,0cyclictest0-21swapper/110:20:291
3552992323,0cyclictest0-21swapper/110:19:381
3552992323,0cyclictest0-21swapper/109:21:381
3552992322,1cyclictest28950-21diskmemload10:01:391
3552992321,1cyclictest0-21swapper/111:52:061
3552992321,1cyclictest0-21swapper/111:35:101
3552992321,1cyclictest0-21swapper/111:22:391
3552992321,1cyclictest0-21swapper/111:15:011
355299230,23cyclictest0-21swapper/112:18:071
355299230,23cyclictest0-21swapper/109:42:221
355299230,23cyclictest0-21swapper/109:28:481
355299230,22cyclictest0-21swapper/112:05:421
355299230,1cyclictest28950-21diskmemload11:33:041
355299230,1cyclictest0-21swapper/111:40:121
355299230,0cyclictest0-21swapper/110:42:041
3551992323,0cyclictest28950-21diskmemload10:54:390
3551992323,0cyclictest0-21swapper/012:17:500
3551992323,0cyclictest0-21swapper/012:08:520
3551992323,0cyclictest0-21swapper/011:05:590
3551992323,0cyclictest0-21swapper/010:57:110
3551992323,0cyclictest0-21swapper/009:39:330
3551992323,0cyclictest0-21swapper/009:39:330
3551992322,1cyclictest7001-21diskmemload09:19:390
3551992322,1cyclictest28950-21diskmemload09:27:530
3551992321,1cyclictest16924-21grep08:45:000
3551992320,2cyclictest3584-21cron10:50:000
355199230,2cyclictest14773-21awk10:29:150
355199230,2cyclictest10917-21ssh11:59:150
355199230,23cyclictest0-21swapper/012:30:280
355199230,23cyclictest0-21swapper/011:30:370
355199230,22cyclictest29489-21ssh09:41:340
355199230,22cyclictest28950-21diskmemload10:03:140
355199230,22cyclictest17351-21ssh12:37:340
355199230,22cyclictest0-21swapper/010:10:390
355199230,1cyclictest0-21swapper/009:30:020
355199230,0cyclictest0-21swapper/011:47:100
355199230,0cyclictest0-21swapper/011:39:560
355199230,0cyclictest0-21swapper/011:25:160
355199230,0cyclictest0-21swapper/009:24:070
355199230,0cyclictest0-21swapper/009:12:470
3557992222,0cyclictest0-21swapper/311:00:223
3557992222,0cyclictest0-21swapper/310:55:563
3557992222,0cyclictest0-21swapper/309:17:493
3557992222,0cyclictest0-21swapper/309:12:393
3557992221,1cyclictest808-21rm12:21:213
3557992220,1cyclictest13134-21apt07:30:013
3557992220,1cyclictest0-21swapper/308:15:013
3557992219,2cyclictest4966-21rm10:51:553
355799220,21cyclictest28950-21diskmemload09:30:563
355799220,21cyclictest15478-21taskset11:33:183
355799220,21cyclictest0-21swapper/311:17:133
355799220,1cyclictest16105-21apt-get07:39:043
355799220,0cyclictest0-21swapper/309:29:383
3556992222,0cyclictest0-21swapper/210:50:272
3556992220,1cyclictest8921-21apt-get07:24:042
3556992220,1cyclictest609-21rs:main2
3556992220,1cyclictest313-21systemd-journal07:50:002
3556992220,1cyclictest29338-21apt-get11:15:022
355699220,2cyclictest28490-21ssh12:17:052
355699220,21cyclictest1693-21ssh11:50:162
355699220,21cyclictest11313-21apt-get07:29:022
355699220,21cyclictest0-21swapper/211:35:362
355699220,1cyclictest7887-21sh09:20:422
355699220,1cyclictest13826-21ssh09:58:012
355699220,1cyclictest10712-21ssh10:25:242
355699220,1cyclictest0-21swapper/211:41:112
355699220,1cyclictest0-21swapper/210:12:542
355699220,1cyclictest0-21swapper/209:15:092
355699220,1cyclictest0-21swapper/209:10:052
3552992222,0cyclictest0-21swapper/110:45:211
3552992222,0cyclictest0-21swapper/109:37:021
3552992222,0cyclictest0-21swapper/109:37:021
3552992222,0cyclictest0-21swapper/109:10:051
355299220,22cyclictest28643-21grep11:14:131
355299220,22cyclictest0-21swapper/110:10:361
355299220,21cyclictest6708-21ssh11:55:061
355299220,21cyclictest32525-21munin-run08:10:011
355299220,21cyclictest0-21swapper/110:50:191
355299220,21cyclictest0-21swapper/110:05:351
355299220,21cyclictest0-21swapper/109:16:381
355299220,21cyclictest0-21swapper/108:04:041
355299220,21cyclictest0-21swapper/108:04:041
355299220,1cyclictest5936-21apt07:15:011
355299220,1cyclictest5794-21sh12:26:101
355299220,1cyclictest26574-21perf09:05:011
355299220,1cyclictest21029-21apt-get07:49:041
355299220,1cyclictest16028-21sh12:35:261
355299220,1cyclictest0-21swapper/111:25:431
355299220,1cyclictest0-21swapper/110:30:111
3551992222,0cyclictest28950-21diskmemload11:10:560
3551992222,0cyclictest0-21swapper/012:21:530
3551992221,0cyclictest0-21swapper/008:39:040
355199220,21cyclictest641-21apt-get08:14:040
355199220,21cyclictest28950-21diskmemload10:15:170
355199220,21cyclictest2534-21cut11:20:010
355199220,21cyclictest21732-21ssh10:36:390
355199220,21cyclictest18629-21apt-get07:44:040
355199220,21cyclictest0-21swapper/010:44:040
355199220,21cyclictest0-21swapper/007:14:040
355199220,1cyclictest4697-21ssh11:23:090
355199220,1cyclictest2608-21ssh11:51:440
355199220,1cyclictest0-21swapper/009:47:290
355199220,1cyclictest0-21swapper/007:40:000
355199220,0cyclictest0-21swapper/011:01:280
3557992120,1cyclictest10284-21apt-get08:34:053
3557992119,1cyclictest0-21swapper/308:50:013
355799210,0cyclictest0-21swapper/310:42:263
355799210,0cyclictest0-21swapper/309:36:423
355799210,0cyclictest0-21swapper/309:36:423
3556992119,1cyclictest2482-21idleruntime-cro08:15:012
355699210,21cyclictest0-21swapper/210:45:222
355699210,0cyclictest0-21swapper/212:20:402
355299210,21cyclictest0-21swapper/109:47:031
355299210,1cyclictest17485-21apt-get08:49:041
3551992121,0cyclictest0-21swapper/008:29:050
3551992119,1cyclictest28955-21cron09:10:010
355199210,0cyclictest0-21swapper/009:04:040
355199210,0cyclictest0-21swapper/008:09:050
355199210,0cyclictest0-21swapper/007:34:050
3557992020,0cyclictest7886-21apt-get08:29:053
3557992019,1cyclictest28966-21apt09:10:013
355799200,0cyclictest0-21swapper/308:09:043
355799200,0cyclictest0-21swapper/307:54:043
3556992020,0cyclictest0-21swapper/208:49:042
3556992020,0cyclictest0-21swapper/208:34:052
3552992019,1cyclictest8355-21perf07:20:011
355299200,0cyclictest0-21swapper/107:24:041
3551992020,0cyclictest0-21swapper/008:34:050
3551992019,1cyclictest5491-21apt-get08:24:040
355199200,0cyclictest0-21swapper/008:49:030
3557991919,0cyclictest0-21swapper/308:44:043
3557991917,1cyclictest0-21swapper/307:19:053
3556991919,0cyclictest0-21swapper/207:54:042
3556991919,0cyclictest0-21swapper/207:19:052
3556991918,1cyclictest15092-21apt-get08:44:042
3556991916,2cyclictest21694-21sh08:55:012
3552991919,0cyclictest0-21swapper/107:29:021
3552991918,0cyclictest0-21swapper/107:39:041
355299190,1cyclictest25874-21apt-get07:59:041
355299190,1cyclictest15511-21cron07:35:001
3551991917,1cyclictest8921-21apt-get07:24:040
3556991818,0cyclictest0-21swapper/207:44:042
3556991818,0cyclictest0-21swapper/207:34:052
3551991818,0cyclictest0-21swapper/007:59:040
3551991818,0cyclictest0-21swapper/007:49:040
3557991717,0cyclictest0-21swapper/308:39:043
3557991716,1cyclictest27710-21perf08:00:013
355799170,0cyclictest19885-21apt-get08:54:053
3556991717,0cyclictest0-21swapper/208:19:062
3552991717,0cyclictest0-21swapper/107:44:031
3557991616,0cyclictest0-21swapper/307:14:043
3556991614,1cyclictest30687-21apt-get08:09:042
355699160,3cyclictest0-21swapper/209:04:042
3552991614,1cyclictest23425-21apt-get07:54:041
355299160,15cyclictest0-21swapper/108:59:131
3551991616,0cyclictest0-21swapper/008:19:050
3551991614,1cyclictest0-21swapper/008:03:000
3551991614,1cyclictest0-21swapper/008:03:000
3557991515,0cyclictest13711-21apt-get07:34:053
3557991512,2cyclictest7297-21sh08:25:003
3556991515,0cyclictest0-21swapper/208:04:052
3556991515,0cyclictest0-21swapper/208:04:052
3556991513,1cyclictest0-21swapper/208:40:002
3552991515,0cyclictest0-21swapper/108:44:041
3552991514,1cyclictest0-21swapper/108:19:061
3551991515,0cyclictest0-21swapper/008:53:230
3557991414,0cyclictest0-21swapper/307:41:563
355799140,14cyclictest0-21swapper/308:56:103
355799140,14cyclictest0-21swapper/308:15:313
355799140,0cyclictest0-21swapper/307:45:023
355799140,0cyclictest0-21swapper/307:20:213
355699140,14cyclictest0-21swapper/209:05:222
355699140,14cyclictest0-21swapper/207:12:372
355699140,0cyclictest0-21swapper/207:35:592
3552991414,0cyclictest0-21swapper/108:25:391
355299140,14cyclictest0-21swapper/108:50:021
355299140,14cyclictest0-21swapper/108:30:581
355299140,0cyclictest0-21swapper/108:37:061
355299140,0cyclictest0-21swapper/108:10:011
3551991414,0cyclictest0-21swapper/008:55:140
3551991414,0cyclictest0-21swapper/007:25:010
3551991414,0cyclictest0-21swapper/007:15:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional