You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 22:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Mar 17, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304699250,24cyclictest29245-21diskmemload11:39:103
304699250,24cyclictest13276-21ssh09:25:073
303799250,24cyclictest4689-21rm11:51:531
303799250,24cyclictest32062-21which12:17:181
303799250,24cyclictest0-21swapper/111:57:211
3032992523,1cyclictest0-21swapper/010:02:230
303299250,2cyclictest313-21systemd-journal08:45:000
303299250,25cyclictest0-21swapper/012:10:030
303299250,24cyclictest29245-21diskmemload11:13:450
303299250,1cyclictest62550irq/127-eno112:18:340
3046992424,0cyclictest0-21swapper/311:12:003
304699240,24cyclictest29245-21diskmemload11:53:293
304699240,24cyclictest0-21swapper/311:34:043
304699240,23cyclictest31344-21df09:12:153
304699240,0cyclictest0-21swapper/309:36:413
3041992423,1cyclictest1197-21ssh10:47:152
3041992423,1cyclictest10388-21ssh10:55:232
304199240,23cyclictest9367-21ssh09:22:072
304199240,23cyclictest31206-21ssh11:15:232
304199240,23cyclictest18080-21sh12:03:092
304199240,23cyclictest1193-21ssh12:18:012
3037992424,0cyclictest0-21swapper/110:33:271
3037992423,1cyclictest0-21swapper/112:32:161
303799240,24cyclictest0-21swapper/110:14:151
303799240,23cyclictest29245-21diskmemload10:02:201
303799240,23cyclictest28726-21sh11:43:001
303799240,23cyclictest0-21swapper/112:10:331
303799240,23cyclictest0-21swapper/109:16:591
303799240,1cyclictest0-21swapper/109:31:311
3032992424,0cyclictest0-21swapper/010:07:110
3032992423,1cyclictest141rcuc/012:25:160
3032992423,1cyclictest0-21swapper/010:36:090
3032992422,1cyclictest0-21swapper/009:50:170
3032992422,1cyclictest0-21swapper/009:15:180
3032992421,2cyclictest10470-21/usr/sbin/munin11:57:230
303299240,24cyclictest0-21swapper/011:25:500
303299240,24cyclictest0-21swapper/011:18:140
303299240,23cyclictest29245-21diskmemload12:31:380
303299240,23cyclictest0-21swapper/011:47:260
303299240,23cyclictest0-21swapper/009:35:580
303299240,1cyclictest0-21swapper/010:49:440
3046992323,0cyclictest0-21swapper/311:16:353
3046992323,0cyclictest0-21swapper/310:35:053
3046992323,0cyclictest0-21swapper/310:07:143
304699230,2cyclictest22241-21rm09:33:193
304699230,22cyclictest30718-21ssh11:45:453
304699230,22cyclictest25909-21ssh12:11:513
304699230,22cyclictest25580-21sh11:40:493
304699230,22cyclictest17953-21turbostat.cron07:40:003
304699230,1cyclictest3483-21ssh09:16:123
304699230,1cyclictest0-21swapper/310:13:043
304699230,0cyclictest29245-21diskmemload11:55:463
304699230,0cyclictest29245-21diskmemload10:44:073
304699230,0cyclictest29245-21diskmemload10:29:293
304699230,0cyclictest0-21swapper/312:26:453
304699230,0cyclictest0-21swapper/309:55:103
3041992323,0cyclictest29245-21diskmemload11:25:102
3041992323,0cyclictest0-21swapper/212:35:422
3041992323,0cyclictest0-21swapper/212:30:542
3041992323,0cyclictest0-21swapper/209:40:472
3041992323,0cyclictest0-21swapper/209:40:472
3041992322,1cyclictest6607-21ssh10:20:502
3041992321,1cyclictest5053-21rm09:47:352
3041992321,1cyclictest0-21swapper/209:31:362
3041992320,2cyclictest7077-21ssh09:50:142
3041992318,4cyclictest26116-21ssh12:12:092
304199230,3cyclictest0-21swapper/212:09:432
304199230,2cyclictest8561-21ssh11:24:392
304199230,23cyclictest29245-21diskmemload09:18:372
304199230,23cyclictest0-21swapper/212:26:002
304199230,23cyclictest0-21swapper/211:12:142
304199230,22cyclictest9164-21ssh11:55:112
304199230,22cyclictest6282-21ptp4l11:52:222
304199230,22cyclictest5310-21sh10:50:302
304199230,22cyclictest29245-21diskmemload10:41:372
304199230,22cyclictest22798-21rm10:05:342
304199230,22cyclictest16736-21ssh10:30:242
304199230,22cyclictest12948-21ssh09:56:272
304199230,22cyclictest0-21swapper/209:11:322
304199230,21cyclictest313-21systemd-journal09:10:012
304199230,0cyclictest29245-21diskmemload10:16:262
304199230,0cyclictest0-21swapper/210:35:042
304199230,0cyclictest0-21swapper/210:03:072
3037992323,0cyclictest29245-21diskmemload12:35:471
3037992323,0cyclictest0-21swapper/112:24:221
3037992323,0cyclictest0-21swapper/111:39:221
3037992323,0cyclictest0-21swapper/110:35:371
3037992323,0cyclictest0-21swapper/110:20:241
3037992323,0cyclictest0-21swapper/110:16:361
3037992323,0cyclictest0-21swapper/109:58:201
3037992323,0cyclictest0-21swapper/109:11:541
3037992321,1cyclictest0-21swapper/110:42:171
3037992321,1cyclictest0-21swapper/109:36:541
303799230,2cyclictest21188-21sh11:06:001
303799230,22cyclictest3962-21sh11:20:101
303799230,22cyclictest29245-21diskmemload10:53:111
303799230,22cyclictest2418-21rm09:46:121
303799230,22cyclictest20369-21idleruntime-cro07:45:001
303799230,22cyclictest17526-21cut11:32:231
303799230,22cyclictest11931-21sh10:25:581
303799230,22cyclictest0-21swapper/111:47:251
303799230,22cyclictest0-21swapper/109:40:121
303799230,22cyclictest0-21swapper/109:40:121
303799230,0cyclictest0-21swapper/112:27:181
303799230,0cyclictest0-21swapper/111:27:281
303799230,0cyclictest0-21swapper/107:52:141
3032992323,0cyclictest0-21swapper/012:03:480
3032992322,1cyclictest14519-21kworker/u8:110:15:350
3032992321,1cyclictest13-21ksoftirqd/011:44:060
3032992321,1cyclictest0-21swapper/009:42:040
3032992321,1cyclictest0-21swapper/009:42:040
3032992320,2cyclictest0-21swapper/009:21:330
303299230,2cyclictest0-21swapper/010:27:130
303299230,23cyclictest29245-21diskmemload09:47:320
303299230,23cyclictest0-21swapper/010:22:000
303299230,23cyclictest0-21swapper/010:13:500
303299230,22cyclictest7541-21ssh11:53:320
303299230,22cyclictest29245-21diskmemload12:37:080
303299230,22cyclictest0-21swapper/011:30:300
303299230,22cyclictest0-21swapper/011:00:010
303299230,22cyclictest0-21swapper/008:35:000
303299230,0cyclictest0-21swapper/012:07:540
303299230,0cyclictest0-21swapper/009:57:030
303299230,0cyclictest0-21swapper/009:30:360
3046992222,0cyclictest29245-21diskmemload09:46:073
3046992222,0cyclictest0-21swapper/312:35:243
3046992222,0cyclictest0-21swapper/312:22:173
3046992222,0cyclictest0-21swapper/312:17:213
3046992220,1cyclictest27577-21sendmail-msp08:00:003
3046992220,1cyclictest22515-21timerandwakeup12:07:233
3046992220,1cyclictest22073-21perf08:55:013
304699220,22cyclictest29245-21diskmemload10:52:243
304699220,22cyclictest0-21swapper/309:20:453
304699220,21cyclictest29245-21diskmemload11:21:423
304699220,21cyclictest29245-21diskmemload09:50:303
304699220,21cyclictest15410-21ssh11:00:063
304699220,21cyclictest0-21swapper/309:41:043
304699220,21cyclictest0-21swapper/309:41:043
304699220,1cyclictest18329-21sh10:01:343
304699220,0cyclictest0-21swapper/311:28:033
304699220,0cyclictest0-21swapper/310:46:203
304699220,0cyclictest0-21swapper/310:30:583
304699220,0cyclictest0-21swapper/310:24:573
3041992222,0cyclictest0-21swapper/211:32:132
3041992221,1cyclictest0-21swapper/211:42:322
3041992220,1cyclictest15757-21ssh11:00:372
304199220,22cyclictest28680-21ssh10:10:592
304199220,22cyclictest0-21swapper/211:45:452
304199220,21cyclictest15983-21apt-get07:37:142
304199220,21cyclictest11975-21ssh10:26:012
304199220,21cyclictest0-21swapper/212:21:212
304199220,21cyclictest0-21swapper/211:06:092
304199220,0cyclictest0-21swapper/211:37:122
3037992221,0cyclictest0-21swapper/107:47:131
3037992220,1cyclictest4815-21sendmail-msp08:20:011
303799220,22cyclictest0-21swapper/112:05:231
303799220,21cyclictest29245-21diskmemload11:10:221
303799220,21cyclictest16598-21diskmemload11:01:521
303799220,21cyclictest11392-21ssh09:22:321
303799220,21cyclictest0-21swapper/112:01:231
303799220,21cyclictest0-21swapper/110:06:131
303799220,21cyclictest0-21swapper/109:25:321
303799220,21cyclictest0-21swapper/109:07:141
303799220,21cyclictest0-21swapper/107:57:131
303799220,21cyclictest0-21swapper/107:35:011
303799220,1cyclictest0-21swapper/111:18:421
303799220,1cyclictest0-21swapper/109:50:511
3032992222,0cyclictest0-21swapper/011:22:090
3032992221,1cyclictest62550irq/127-eno111:35:010
3032992220,1cyclictest2350-21perf08:15:010
3032992220,1cyclictest0-21swapper/010:55:110
3032992220,1cyclictest0-21swapper/010:30:050
3032992220,1cyclictest0-21swapper/008:07:150
3032992215,7cyclictest8137-21kworker/0:007:42:350
303299220,22cyclictest0-21swapper/010:40:340
303299220,21cyclictest29245-21diskmemload10:51:080
303299220,21cyclictest29245-21diskmemload09:10:040
303299220,21cyclictest22749-21turbostat07:50:000
303299220,21cyclictest0-21swapper/012:20:090
303299220,1cyclictest0-21swapper/011:05:380
3046992121,0cyclictest0-21swapper/310:18:073
3046992121,0cyclictest0-21swapper/307:17:153
3046992121,0cyclictest0-21swapper/307:17:153
3046992120,1cyclictest14433-21ssh12:00:113
3046992118,3cyclictest28001-21apt-get08:02:153
3046992118,2cyclictest14794-21sh08:40:003
304699210,21cyclictest0-21swapper/310:56:173
304699210,20cyclictest2777-21apt-get08:17:163
304699210,1cyclictest14238-21ssh12:31:453
304699210,0cyclictest24906-21apt-get09:02:143
304699210,0cyclictest0-21swapper/311:05:153
304699210,0cyclictest0-21swapper/308:27:133
3041992121,0cyclictest0-21swapper/209:36:342
3041992120,0cyclictest0-21swapper/208:02:152
304199210,20cyclictest0-21swapper/208:17:162
304199210,1cyclictest29245-21diskmemload09:25:112
3037992121,0cyclictest0-21swapper/108:57:141
303799210,20cyclictest13059-21idleruntime-cro07:30:011
303799210,20cyclictest0-21swapper/108:52:141
303799210,20cyclictest0-21swapper/108:35:001
303299211,20cyclictest8137-21kworker/0:008:04:270
303299210,20cyclictest8695-21apt-get07:22:150
303299210,20cyclictest0-21swapper/007:37:140
303299210,20cyclictest0-21swapper/007:17:150
303299210,20cyclictest0-21swapper/007:17:150
303299210,20cyclictest0-21swapper/007:12:130
303299210,0cyclictest22490-21apt-get08:57:140
3046992020,0cyclictest0-21swapper/307:42:133
3046992019,0cyclictest10236-21apt-get08:30:023
3041992019,0cyclictest0-21swapper/207:52:142
3037992020,0cyclictest0-21swapper/108:22:141
303799200,0cyclictest0-21swapper/107:15:021
303799200,0cyclictest0-21swapper/107:15:021
303299202,18cyclictest8137-21kworker/0:008:21:270
3032992020,0cyclictest0-21swapper/007:52:130
3046991919,0cyclictest0-21swapper/307:12:133
3041991919,0cyclictest11086-21apt-get07:27:142
3041991919,0cyclictest0-21swapper/208:42:112
3041991919,0cyclictest0-21swapper/208:22:142
3041991919,0cyclictest0-21swapper/207:57:132
3041991919,0cyclictest0-21swapper/207:12:132
3037991919,0cyclictest12839-21apt-get08:37:151
3037991919,0cyclictest0-21swapper/108:42:111
3037991919,0cyclictest0-21swapper/108:07:141
3032991919,0cyclictest0-21swapper/009:07:140
3032991919,0cyclictest0-21swapper/008:47:160
3032991919,0cyclictest0-21swapper/008:37:150
303299190,19cyclictest8137-21kworker/0:007:55:310
3041991818,0cyclictest9621-21apt-get08:30:022
3041991818,0cyclictest0-21swapper/208:12:122
3041991818,0cyclictest0-21swapper/207:47:132
3041991818,0cyclictest0-21swapper/207:42:132
3041991818,0cyclictest0-21swapper/207:17:152
3041991818,0cyclictest0-21swapper/207:17:152
3032991818,0cyclictest0-21swapper/008:55:010
3032991818,0cyclictest0-21swapper/008:27:140
3032991818,0cyclictest0-21swapper/008:20:010
3032991817,1cyclictest13484-21apt-get07:32:130
3046991717,0cyclictest27298-21apt-get09:07:143
3046991717,0cyclictest0-21swapper/308:47:163
3046991717,0cyclictest0-21swapper/307:32:133
3041991717,0cyclictest7647-21apt-get08:27:132
3041991717,0cyclictest0-21swapper/207:32:142
3037991715,1cyclictest2360-21munin-run08:15:011
3046991616,0cyclictest0-21swapper/308:57:143
3046991616,0cyclictest0-21swapper/308:42:113
3046991616,0cyclictest0-21swapper/308:07:153
304699160,15cyclictest0-21swapper/307:55:003
3041991616,0cyclictest8695-21apt-get07:22:142
3041991616,0cyclictest0-21swapper/208:57:142
3037991616,0cyclictest3428-21apt-get07:12:141
3037991615,0cyclictest0-21swapper/107:22:151
3046991515,0cyclictest0-21swapper/308:22:143
3046991515,0cyclictest0-21swapper/307:46:373
3046991515,0cyclictest0-21swapper/307:22:143
3046991514,1cyclictest323-21apt-get08:12:133
3046991513,1cyclictest11727-21hddtemp_smartct07:27:163
3041991513,1cyclictest25954-21ntp_states09:02:192
3041991513,1cyclictest18199-21perl08:47:182
304199150,1cyclictest0-21swapper/208:37:192
303799152,3cyclictest17975-21awk07:40:001
3037991513,1cyclictest26887-21munin-run09:05:011
303299150,1cyclictest0-21swapper/007:27:130
3041991414,0cyclictest0-21swapper/208:50:152
304199140,0cyclictest0-21swapper/208:05:442
303799140,14cyclictest0-21swapper/108:45:271
303799140,14cyclictest0-21swapper/108:00:141
3032991414,0cyclictest0-21swapper/009:00:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional