You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 01:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Sep 23, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18787992725,1cyclictest22-21ksoftirqd/109:35:011
18790992622,1cyclictest3935-21sh09:59:402
1878499260,1cyclictest606-21dbus-daemon11:50:010
1879799250,24cyclictest12577-21diskmemload11:30:173
1878799250,25cyclictest12577-21diskmemload09:22:481
1878799250,24cyclictest0-21swapper/110:48:291
18784992523,1cyclictest27780-21ssh12:17:480
18784992523,1cyclictest12577-21diskmemload10:21:090
1878499250,24cyclictest12577-21diskmemload10:32:130
1878499250,24cyclictest12577-21diskmemload10:15:430
1879799240,2cyclictest10189-21awk09:05:003
1879799240,23cyclictest849-21ssh12:22:473
1879799240,23cyclictest7835-21sh09:33:273
1879799240,23cyclictest3316-21munin-run07:45:003
1879799240,23cyclictest26448-21sh09:22:083
1879799240,0cyclictest12577-21diskmemload11:58:183
18790992422,1cyclictest28-21ksoftirqd/212:05:012
1879099240,23cyclictest14966-21rm09:12:362
1879099240,23cyclictest12577-21diskmemload11:03:192
1879099240,23cyclictest0-21swapper/212:38:132
18787992424,0cyclictest0-21swapper/111:02:421
18787992422,1cyclictest0-21swapper/110:12:381
1878799240,23cyclictest12577-21diskmemload12:28:071
1878799240,23cyclictest0-21swapper/111:20:021
1878799240,23cyclictest0-21swapper/110:59:091
1878799240,23cyclictest0-21swapper/110:59:091
1878799240,23cyclictest0-21swapper/109:59:011
1878799240,23cyclictest0-21swapper/109:49:141
1878799240,0cyclictest12577-21diskmemload10:54:091
1878799240,0cyclictest0-21swapper/109:53:031
1878799240,0cyclictest0-21swapper/109:41:281
18784992424,0cyclictest62550irq/127-eno110:37:150
18784992422,1cyclictest10567-21munin-run08:00:010
18784992421,2cyclictest11918-21cron11:05:010
1878499240,24cyclictest12577-21diskmemload09:41:280
1878499240,24cyclictest12577-21diskmemload09:32:350
1878499240,23cyclictest0-21swapper/009:49:080
1878499240,0cyclictest0-21swapper/010:03:370
18797992323,0cyclictest12577-21diskmemload09:16:153
18797992323,0cyclictest0-21swapper/311:48:513
18797992323,0cyclictest0-21swapper/311:21:503
18797992323,0cyclictest0-21swapper/310:11:373
18797992322,1cyclictest0-21swapper/310:19:063
18797992321,2cyclictest10671-21ssh10:06:033
18797992320,2cyclictest15994-21ssh10:39:383
18797992320,2cyclictest14549-21cron09:40:003
1879799230,23cyclictest12577-21diskmemload09:40:163
1879799230,23cyclictest0-21swapper/311:17:073
1879799230,23cyclictest0-21swapper/310:03:083
1879799230,22cyclictest32655-21apt-get11:53:013
1879799230,22cyclictest2777-21sh10:57:223
1879799230,22cyclictest2777-21sh10:57:223
1879799230,22cyclictest22304-21apt-key10:45:013
1879799230,22cyclictest21132-21latency_hist07:15:013
1879799230,22cyclictest20937-21ssh10:43:513
1879799230,22cyclictest10533-21ssh12:30:483
1879799230,22cyclictest0-21swapper/309:50:473
1879799230,0cyclictest0-21swapper/310:30:353
18790992323,0cyclictest0-21swapper/210:53:582
18790992323,0cyclictest0-21swapper/209:30:532
18790992322,1cyclictest12577-21diskmemload10:02:032
18790992321,1cyclictest0-21swapper/211:15:302
18790992321,1cyclictest0-21swapper/208:55:002
1879099230,2cyclictest15795-21ssh09:41:232
1879099230,23cyclictest0-21swapper/212:30:152
1879099230,23cyclictest0-21swapper/212:07:432
1879099230,23cyclictest0-21swapper/210:27:532
1879099230,23cyclictest0-21swapper/209:52:372
1879099230,22cyclictest5652-21sh11:57:502
1879099230,22cyclictest3868-21ssh11:27:082
1879099230,22cyclictest23583-21idleruntime-cro07:20:002
1879099230,22cyclictest12577-21diskmemload12:26:282
1879099230,1cyclictest783-21snmpd11:48:412
1879099230,1cyclictest23500-21apt-get08:28:002
1879099230,0cyclictest0-21swapper/211:40:072
1879099230,0cyclictest0-21swapper/211:05:322
1879099230,0cyclictest0-21swapper/210:47:332
1879099230,0cyclictest0-21swapper/210:33:152
1879099230,0cyclictest0-21swapper/210:05:072
18787992323,0cyclictest0-21swapper/112:15:101
18787992323,0cyclictest0-21swapper/112:08:021
18787992323,0cyclictest0-21swapper/112:03:461
18787992323,0cyclictest0-21swapper/110:01:541
18787992323,0cyclictest0-21swapper/109:37:511
18787992323,0cyclictest0-21swapper/108:43:011
18787992322,1cyclictest27584-21ssh11:48:061
18787992321,1cyclictest0-21swapper/110:34:021
1878799230,23cyclictest0-21swapper/111:32:211
1878799230,23cyclictest0-21swapper/110:44:221
1878799230,23cyclictest0-21swapper/109:29:001
1878799230,22cyclictest606-21dbus-daemon07:40:001
1878799230,22cyclictest0-21swapper/112:33:101
1878799230,0cyclictest0-21swapper/112:35:331
1878799230,0cyclictest0-21swapper/110:36:351
1878799230,0cyclictest0-21swapper/109:13:311
18784992323,0cyclictest62550irq/127-eno109:28:380
18784992323,0cyclictest0-21swapper/012:36:000
18784992323,0cyclictest0-21swapper/011:05:350
18784992321,1cyclictest0-21swapper/012:25:300
18784992321,1cyclictest0-21swapper/011:15:160
18784992321,1cyclictest0-21swapper/011:13:420
18784992320,2cyclictest18146-21awk08:15:000
1878499231,1cyclictest25899-21apt-get08:33:010
1878499230,23cyclictest0-21swapper/011:38:310
1878499230,23cyclictest0-21swapper/011:25:320
1878499230,23cyclictest0-21swapper/009:10:270
1878499230,22cyclictest567-21munin-run08:45:010
1878499230,22cyclictest30403-21latency_hist09:25:010
1878499230,22cyclictest12577-21diskmemload11:41:550
1878499230,22cyclictest12577-21diskmemload09:16:070
1878499230,22cyclictest10693-21apt-get09:08:020
1878499230,22cyclictest0-21swapper/011:23:090
1878499230,0cyclictest12577-21diskmemload11:55:110
1878499230,0cyclictest0-21swapper/012:32:240
1878499230,0cyclictest0-21swapper/010:26:180
1878499230,0cyclictest0-21swapper/010:09:120
18797992222,0cyclictest12577-21diskmemload12:35:353
18797992222,0cyclictest0-21swapper/311:10:113
18797992222,0cyclictest0-21swapper/311:05:113
18797992222,0cyclictest0-21swapper/310:52:543
18797992220,1cyclictest25999-21awk07:25:003
18797992220,1cyclictest0-21swapper/312:25:453
1879799220,22cyclictest12577-21diskmemload11:36:053
1879799220,22cyclictest0-21swapper/311:40:073
1879799220,21cyclictest27175-21ssh12:16:523
1879799220,21cyclictest17514-21ssh12:08:053
1879799220,21cyclictest13267-21ssh09:10:323
1879799220,21cyclictest0-21swapper/312:03:023
1879799220,21cyclictest0-21swapper/311:27:323
1879799220,1cyclictest31943-21ssh09:55:573
1879799220,0cyclictest0-21swapper/312:12:393
1879799220,0cyclictest0-21swapper/311:03:293
1879799220,0cyclictest0-21swapper/310:20:243
18790992222,0cyclictest0-21swapper/212:17:462
18790992222,0cyclictest0-21swapper/211:21:182
18790992222,0cyclictest0-21swapper/210:11:502
18790992220,1cyclictest29249-21/usr/sbin/munin10:23:032
18790992220,1cyclictest20418-21ssh12:10:182
1879099220,21cyclictest32225-21ssh12:21:182
1879099220,21cyclictest20287-21ssh09:45:032
1879099220,21cyclictest1687-21ssh10:55:502
1879099220,21cyclictest1687-21ssh10:55:502
1879099220,21cyclictest15965-21apt-get08:10:022
1879099220,21cyclictest12577-21diskmemload10:16:062
1879099220,21cyclictest0-21swapper/210:41:042
1879099220,21cyclictest0-21swapper/209:20:492
1879099220,21cyclictest0-21swapper/207:48:002
1879099220,1cyclictest19080-21rm09:15:082
1879099220,1cyclictest0-21swapper/211:10:452
18787992222,0cyclictest0-21swapper/111:56:081
18787992222,0cyclictest0-21swapper/108:38:021
18787992220,1cyclictest0-21swapper/111:25:031
18787992220,1cyclictest0-21swapper/110:22:461
18787992220,1cyclictest0-21swapper/108:28:001
18787992219,2cyclictest2996-21apt08:50:011
1878799220,21cyclictest8133-21cron07:55:011
1878799220,21cyclictest7811-21munin-run09:00:001
1878799220,21cyclictest21626-21apt-get07:18:011
1878799220,21cyclictest12990-21uname10:08:071
1878799220,21cyclictest0-21swapper/111:35:341
1878799220,21cyclictest0-21swapper/110:15:481
1878799220,21cyclictest0-21swapper/109:15:181
1878799220,1cyclictest24304-21rm11:15:401
1878799220,1cyclictest0-21swapper/111:40:461
1878799220,1cyclictest0-21swapper/110:25:191
1878799220,0cyclictest12577-21diskmemload12:20:041
1878799220,0cyclictest0-21swapper/111:50:021
18784992222,0cyclictest12577-21diskmemload10:55:380
18784992222,0cyclictest12577-21diskmemload10:55:380
18784992222,0cyclictest0-21swapper/012:01:140
18784992222,0cyclictest0-21swapper/009:57:330
18784992221,1cyclictest0-21swapper/012:20:210
18784992220,1cyclictest0-21swapper/010:53:080
1878499220,2cyclictest30849-21ssh11:50:270
1878499220,21cyclictest23562-21cron07:20:000
1878499220,21cyclictest21152-21sh10:44:080
1878499220,21cyclictest12577-21diskmemload09:35:380
1878499220,21cyclictest0-21swapper/010:45:540
1878499220,21cyclictest0-21swapper/010:13:010
1878499220,21cyclictest0-21swapper/007:33:000
1878499220,1cyclictest0-21swapper/012:12:100
1878499220,0cyclictest0-21swapper/007:23:010
18797992121,0cyclictest0-21swapper/308:28:003
18797992118,2cyclictest10524-21sh08:00:013
1879799210,21cyclictest32465-21ssh09:27:393
1879799210,21cyclictest0-21swapper/310:28:513
1879799210,20cyclictest26488-21apt-get07:28:013
1879799210,20cyclictest20946-21ssh09:46:063
1879799210,20cyclictest15339-21apt-get08:10:013
1879799210,20cyclictest15339-21apt-get08:10:003
1879799210,1cyclictest30222-21latency_hist08:40:013
1879799210,0cyclictest0-21swapper/308:03:013
18790992121,0cyclictest12577-21diskmemload11:35:552
18790992121,0cyclictest12577-21diskmemload11:32:032
18790992121,0cyclictest0-21swapper/210:36:482
18790992121,0cyclictest0-21swapper/209:35:022
18790992120,1cyclictest28874-21kworker/2:208:25:002
18790992119,2cyclictest29887-21apt-get11:50:022
18790992119,1cyclictest15349-21ls08:10:002
18790992116,4cyclictest2982-21awk08:50:012
1879099210,0cyclictest32504-21ssh09:27:422
18787992121,0cyclictest0-21swapper/112:10:061
1878799210,20cyclictest0-21swapper/111:05:021
18784992121,0cyclictest0-21swapper/012:05:060
18784992121,0cyclictest0-21swapper/011:30:050
18784992120,0cyclictest0-21swapper/008:03:010
18784992119,1cyclictest1077-21apt-get08:48:010
1878499210,20cyclictest0-21swapper/009:50:020
1878499210,20cyclictest0-21swapper/008:28:000
1878499210,0cyclictest3483-21apt-get08:53:000
1878499210,0cyclictest31385-21apt-get07:38:020
1878499210,0cyclictest0-21swapper/007:43:010
18797992020,0cyclictest0-21swapper/308:40:023
18790992020,0cyclictest8631-21apt-get07:58:002
18790992020,0cyclictest5882-21apt-get08:58:022
18790992020,0cyclictest0-21swapper/208:38:022
18790992018,1cyclictest0-21swapper/207:40:002
1879099200,20cyclictest0-21swapper/207:23:002
18787992019,1cyclictest0-21swapper/107:23:001
1878799200,0cyclictest0-21swapper/108:53:001
18784992020,0cyclictest0-21swapper/008:38:030
18784992020,0cyclictest0-21swapper/007:48:000
1878499200,20cyclictest0-21swapper/008:58:020
18797991919,0cyclictest0-21swapper/308:33:013
18797991919,0cyclictest0-21swapper/307:38:023
18790991919,0cyclictest0-21swapper/209:03:042
18790991919,0cyclictest0-21swapper/208:40:022
18790991917,1cyclictest12572-21cron09:10:002
18787991919,0cyclictest0-21swapper/107:33:011
18787991918,1cyclictest0-21swapper/109:03:041
18787991917,1cyclictest15362-21munin-run08:10:001
18784991917,1cyclictest0-21swapper/008:08:000
1878499190,18cyclictest21022-21/usr/sbin/munin08:23:040
18797991818,0cyclictest0-21swapper/307:48:003
18797991817,1cyclictest0-21swapper/308:58:023
18790991818,0cyclictest0-21swapper/208:33:002
18790991818,0cyclictest0-21swapper/207:53:012
18787991818,0cyclictest0-21swapper/108:18:011
18787991816,1cyclictest27781-21cron08:35:001
18797991717,0cyclictest6236-21apt-get07:53:013
18797991717,0cyclictest0-21swapper/308:23:023
18787991717,0cyclictest0-21swapper/108:13:031
18787991717,0cyclictest0-21swapper/107:48:001
18787991717,0cyclictest0-21swapper/107:43:021
18797991616,0cyclictest0-21swapper/309:08:023
18797991616,0cyclictest0-21swapper/307:18:013
18790991616,0cyclictest18630-21apt-get08:18:012
18787991616,0cyclictest0-21swapper/108:23:021
18787991614,1cyclictest21142-21apt07:15:011
18787991614,1cyclictest0-21swapper/107:28:031
18784991614,1cyclictest8156-21munin-run07:55:010
18797991515,0cyclictest0-21swapper/308:48:013
18797991515,0cyclictest0-21swapper/308:18:013
18787991515,0cyclictest0-21swapper/109:08:021
1878499150,1cyclictest20525-21ptp4l-jitter07:13:080
1879799140,14cyclictest0-21swapper/308:50:303
1879799140,0cyclictest0-21swapper/307:30:283
18790991414,0cyclictest0-21swapper/208:00:182
18790991414,0cyclictest0-21swapper/207:25:042
1879099140,14cyclictest0-21swapper/207:10:392
1879099140,0cyclictest0-21swapper/207:40:492
1879099140,0cyclictest0-21swapper/207:31:382
1878799140,0cyclictest0-21swapper/108:00:221
18784991414,0cyclictest0-21swapper/008:15:250
18784991414,0cyclictest0-21swapper/007:26:420
1878499140,14cyclictest0-21swapper/009:00:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional