You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-20 - 18:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Thu Aug 20, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3372992623,2cyclictest17926-21sh11:48:001
3378992524,0cyclictest18111-21ssh09:27:273
337899250,24cyclictest30694-21ssh10:06:083
3374992520,4cyclictest0-21swapper/212:11:422
337499250,24cyclictest29484-21diskmemload09:51:282
337299250,24cyclictest29484-21diskmemload10:53:501
337299250,24cyclictest0-21swapper/112:30:011
337299250,24cyclictest0-21swapper/110:40:471
336899250,25cyclictest0-21swapper/010:36:130
336899250,0cyclictest0-21swapper/012:27:280
3378992422,1cyclictest24854-21apt10:30:123
3378992422,1cyclictest0-21swapper/311:29:413
3378992421,2cyclictest19818-21rm09:56:573
3378992421,2cyclictest19818-21rm09:56:573
337899240,23cyclictest29484-21diskmemload09:37:343
337899240,23cyclictest0-21swapper/311:21:413
337899240,23cyclictest0-21swapper/311:19:333
337899240,23cyclictest0-21swapper/310:45:163
3374992422,1cyclictest8423-21apt-get07:20:122
3374992422,1cyclictest29659-21ssh11:58:332
3374992422,1cyclictest29484-21diskmemload10:56:292
337499240,23cyclictest29484-21diskmemload12:07:352
337499240,23cyclictest27123-21sleep09:05:002
337499240,23cyclictest25761-21sh10:02:092
337499240,23cyclictest0-21swapper/210:35:142
337499240,23cyclictest0-21swapper/210:20:282
337499240,1cyclictest0-21swapper/210:05:172
3372992422,1cyclictest0-21swapper/110:45:291
337299240,23cyclictest2584-21apt-get11:35:121
337299240,23cyclictest11605-21sh09:21:141
337299240,23cyclictest0-21swapper/109:15:291
3368992423,1cyclictest0-21swapper/011:05:390
3368992423,1cyclictest0-21swapper/010:31:570
3368992422,1cyclictest62550irq/127-eno109:10:210
3368992422,1cyclictest24743-21diskmemload10:00:520
3368992422,1cyclictest16011-21perf09:55:000
3368992421,2cyclictest1397-21rm09:40:410
336899240,23cyclictest0-21swapper/011:33:500
336899240,23cyclictest0-21swapper/011:33:500
336899240,1cyclictest21096-21ssh10:25:310
336899240,1cyclictest0-21swapper/009:28:210
336899240,0cyclictest0-21swapper/012:04:220
336899240,0cyclictest0-21swapper/009:59:020
336899240,0cyclictest0-21swapper/009:59:020
3378992323,0cyclictest0-21swapper/310:57:273
3378992322,0cyclictest0-21swapper/308:15:123
3378992321,1cyclictest0-21swapper/311:14:213
3378992320,2cyclictest10407-21ssh11:40:403
337899230,2cyclictest1795-21sh12:01:153
337899230,23cyclictest29484-21diskmemload12:05:283
337899230,23cyclictest0-21swapper/309:41:133
337899230,22cyclictest4105-21cat10:40:153
337899230,22cyclictest31294-21ssh11:03:523
337899230,22cyclictest29484-21diskmemload12:31:163
337899230,22cyclictest29484-21diskmemload11:45:213
337899230,22cyclictest29183-21sh11:30:053
337899230,22cyclictest29183-21sh11:30:053
337899230,22cyclictest15398-21ssh10:50:123
337899230,22cyclictest11689-21ssh09:21:203
337899230,22cyclictest0-21swapper/310:17:173
337899230,0cyclictest29484-21diskmemload12:20:253
337899230,0cyclictest29484-21diskmemload12:19:013
337899230,0cyclictest0-21swapper/312:26:303
337899230,0cyclictest0-21swapper/311:06:003
337899230,0cyclictest0-21swapper/310:26:083
337899230,0cyclictest0-21swapper/309:30:083
337899230,0cyclictest0-21swapper/309:10:113
3374992323,0cyclictest29484-21diskmemload09:45:302
3374992323,0cyclictest29484-21diskmemload09:25:222
3374992323,0cyclictest0-21swapper/211:12:252
3374992321,1cyclictest0-21swapper/211:45:012
3374992320,2cyclictest7116-21latency_hist08:25:002
3374992320,2cyclictest3719-21ssh12:03:482
3374992320,2cyclictest32438-21rm11:05:012
3374992320,2cyclictest1142-21ssh09:40:232
337499230,23cyclictest10824-21ssh12:38:052
337499230,23cyclictest0-21swapper/211:27:502
337499230,23cyclictest0-21swapper/210:49:332
337499230,23cyclictest0-21swapper/210:12:582
337499230,22cyclictest30136-21ssh11:02:182
337499230,22cyclictest29928-21rm09:10:122
337499230,22cyclictest29484-21diskmemload11:21:132
337499230,22cyclictest29484-21diskmemload10:25:162
337499230,22cyclictest0-21swapper/211:18:052
337499230,22cyclictest0-21swapper/210:15:132
337499230,1cyclictest0-21swapper/209:32:042
337499230,0cyclictest0-21swapper/212:20:132
337499230,0cyclictest0-21swapper/211:39:592
337499230,0cyclictest0-21swapper/209:55:462
337499230,0cyclictest0-21swapper/209:55:462
337499230,0cyclictest0-21swapper/209:24:052
3372992323,0cyclictest0-21swapper/112:37:531
3372992323,0cyclictest0-21swapper/112:11:331
3372992323,0cyclictest0-21swapper/111:04:151
3372992323,0cyclictest0-21swapper/110:30:081
3372992323,0cyclictest0-21swapper/110:25:341
3372992323,0cyclictest0-21swapper/109:46:181
3372992321,1cyclictest32706-21ssh10:35:461
3372992321,1cyclictest21930-21ssh09:59:431
3372992321,1cyclictest21930-21ssh09:59:431
3372992321,1cyclictest0-21swapper/109:41:521
3372992320,2cyclictest9328-21sh10:15:381
3372992320,2cyclictest29814-21ssh12:25:291
337299230,2cyclictest22539-21fschecks_count12:20:121
337299230,23cyclictest0-21swapper/111:40:051
337299230,23cyclictest0-21swapper/111:22:031
337299230,22cyclictest7041-21ssh12:05:381
337299230,22cyclictest24790-21tr11:25:171
337299230,22cyclictest23420-21ssh10:00:161
337299230,22cyclictest18100-21rm10:24:071
337299230,22cyclictest14952-21expr09:25:131
337299230,22cyclictest0-21swapper/111:05:121
337299230,22cyclictest0-21swapper/110:05:121
337299230,0cyclictest29484-21diskmemload11:53:401
337299230,0cyclictest0-21swapper/112:15:271
3368992323,0cyclictest29484-21diskmemload11:40:210
3368992323,0cyclictest0-21swapper/011:25:150
3368992323,0cyclictest0-21swapper/009:45:040
3368992321,1cyclictest3411-21ssh12:30:540
3368992321,1cyclictest27730-21apt-get08:00:110
3368992321,1cyclictest0-21swapper/011:55:130
3368992321,1cyclictest0-21swapper/010:46:120
3368992320,1cyclictest0-21swapper/010:05:040
336899231,21cyclictest62550irq/127-eno109:15:280
336899230,2cyclictest12479-21ssh12:10:260
336899230,22cyclictest9139-21apt-get09:20:110
336899230,22cyclictest7647-21sh12:35:150
336899230,22cyclictest7127-21diskmemload10:15:050
336899230,22cyclictest29484-21diskmemload11:10:140
336899230,22cyclictest27246-21sh12:24:460
336899230,22cyclictest26351-21cron11:00:010
336899230,22cyclictest0-21swapper/010:20:300
336899230,22cyclictest0-21swapper/009:35:120
336899230,22cyclictest0-21swapper/007:55:090
336899230,0cyclictest0-21swapper/011:22:420
336899230,0cyclictest0-21swapper/011:18:100
336899230,0cyclictest0-21swapper/010:40:310
336899230,0cyclictest0-21swapper/009:34:030
3378992222,0cyclictest29484-21diskmemload11:59:003
3378992221,0cyclictest10603-21apt-get12:10:143
3378992220,1cyclictest17379-21apt-get08:45:133
3378992220,1cyclictest0-21swapper/310:10:233
3378992220,1cyclictest0-21swapper/309:15:143
337899220,22cyclictest0-21swapper/310:01:133
337899220,21cyclictest3744-21ssh11:35:183
337899220,21cyclictest31083-21df_inode10:35:143
337899220,21cyclictest22144-21ssh11:51:033
337899220,21cyclictest0-21swapper/310:20:343
337899220,21cyclictest0-21swapper/309:50:503
337899220,21cyclictest0-21swapper/309:45:123
3374992222,0cyclictest0-21swapper/210:50:442
3374992220,2cyclictest29484-21diskmemload10:44:452
3374992220,1cyclictest29484-21diskmemload12:30:042
3374992220,1cyclictest0-21swapper/211:45:162
3374992220,1cyclictest0-21swapper/208:50:022
337499220,2cyclictest29853-21turbostat.cron08:05:002
337499220,21cyclictest29484-21diskmemload12:15:292
337499220,21cyclictest0-21swapper/210:30:152
337499220,1cyclictest29736-21ssh12:25:232
337499220,1cyclictest23466-21ssh11:52:512
337499220,1cyclictest0-21swapper/209:16:262
3372992222,0cyclictest0-21swapper/110:56:331
3372992220,1cyclictest672-21sh12:00:191
3372992220,1cyclictest5331-21ssh10:13:001
3372992220,1cyclictest211rcuc/107:30:001
3372992220,1cyclictest0-21swapper/109:35:391
337299220,22cyclictest0-21swapper/111:15:101
337299220,21cyclictest8137-21dump-pmu-power07:20:001
337299220,21cyclictest6371-21apt-get11:10:131
337299220,21cyclictest25550-21apt-get11:55:131
337299220,21cyclictest11881-21cron08:35:011
337299220,21cyclictest0-21swapper/111:30:081
337299220,21cyclictest0-21swapper/111:30:081
337299220,21cyclictest0-21swapper/109:50:081
337299220,21cyclictest0-21swapper/108:05:121
337299220,1cyclictest9504-21perf08:30:011
337299220,1cyclictest29919-21apt-get09:10:121
337299220,1cyclictest22123-21unixbench_multi09:30:211
3368992222,0cyclictest0-21swapper/011:45:550
3368992222,0cyclictest0-21swapper/011:39:390
3368992220,1cyclictest0-21swapper/012:05:110
3368992219,2cyclictest17104-21latency_hist08:45:000
336899220,22cyclictest19075-21ssh10:53:000
336899220,21cyclictest0-21swapper/011:00:560
336899220,21cyclictest0-21swapper/008:35:130
336899220,1cyclictest22684-21ssh11:51:420
336899220,1cyclictest0-21swapper/012:15:280
336899220,1cyclictest0-21swapper/008:20:000
336899220,1cyclictest0-21swapper/007:35:000
3378992120,0cyclictest9773-21apt-get08:30:103
3378992120,0cyclictest22918-21apt-get07:50:113
3378992119,1cyclictest32577-21apt-get08:10:143
337899210,0cyclictest20524-21apt-get07:45:113
337899210,0cyclictest0-21swapper/307:20:123
3374992121,0cyclictest0-21swapper/211:30:182
3374992121,0cyclictest0-21swapper/211:30:182
3374992120,0cyclictest7377-21apt-get08:25:102
3374992119,1cyclictest12174-21apt-get08:35:132
337499210,1cyclictest27462-21munin-run08:00:002
337499210,0cyclictest0-21swapper/207:10:102
3372992120,0cyclictest20166-21apt-get08:50:101
3372992119,1cyclictest5725-21turbostat07:15:001
3372992119,1cyclictest19511-21munin-plugin-st08:50:001
337299210,20cyclictest0-21swapper/108:35:131
3368992121,0cyclictest0-21swapper/007:45:110
336899210,20cyclictest29484-21diskmemload10:10:180
336899210,0cyclictest0-21swapper/008:45:130
3378992020,0cyclictest0-21swapper/307:35:113
3378992020,0cyclictest0-21swapper/307:15:103
337899200,20cyclictest0-21swapper/307:30:123
3374992020,0cyclictest14306-21apt-get08:40:022
3374992020,0cyclictest0-21swapper/207:45:112
337499200,0cyclictest0-21swapper/208:55:142
337499200,0cyclictest0-21swapper/207:25:112
3368992020,0cyclictest0-21swapper/008:20:110
3368992020,0cyclictest0-21swapper/007:50:110
3368992020,0cyclictest0-21swapper/007:25:110
3368992020,0cyclictest0-21swapper/007:15:100
336899200,0cyclictest15605-21apt-get07:35:110
3378991919,0cyclictest0-21swapper/308:00:123
3378991918,1cyclictest3606-21apt-get07:10:103
3378991918,1cyclictest27377-21apt-get09:05:113
3378991918,0cyclictest0-21swapper/308:05:123
3378991917,1cyclictest14938-21apt-get08:40:023
3374991919,0cyclictest0-21swapper/208:45:132
3374991919,0cyclictest0-21swapper/208:30:102
3374991919,0cyclictest0-21swapper/208:10:132
337499190,19cyclictest0-21swapper/207:40:112
3372991919,0cyclictest13211-21apt-get07:30:111
3372991919,0cyclictest0-21swapper/107:50:111
3372991918,1cyclictest606-21dbus-daemon09:00:001
3368991919,0cyclictest0-21swapper/008:05:120
336899190,0cyclictest0-21swapper/008:50:100
3378991818,0cyclictest0-21swapper/308:35:133
337899180,18cyclictest0-21swapper/308:25:103
3374991818,0cyclictest30127-21apt-get08:05:122
3372991818,0cyclictest0-21swapper/108:40:131
3372991818,0cyclictest0-21swapper/107:20:131
3368991818,0cyclictest0-21swapper/007:45:010
3368991816,1cyclictest5745-21munin-run07:15:000
3378991717,0cyclictest0-21swapper/308:50:103
3378991715,1cyclictest4985-21apt-get08:20:113
3372991717,0cyclictest0-21swapper/107:45:111
3368991717,0cyclictest0-21swapper/009:00:120
3368991715,1cyclictest0-21swapper/008:30:010
3368991714,2cyclictest11902-21basename08:35:010
3378991615,0cyclictest0-21swapper/309:00:123
3378991613,2cyclictest27465-21idleruntime-cro08:00:003
337899160,15cyclictest18127-21apt-get07:40:113
337899160,15cyclictest11720-21memory07:25:153
3372991615,1cyclictest29859-21ls08:05:001
3372991614,1cyclictest29514-21cut09:10:001
3372991614,1cyclictest2559-21apt-get08:15:121
3372991614,1cyclictest0-21swapper/108:00:001
3372991614,1cyclictest0-21swapper/107:40:141
337299160,2cyclictest773-21sed08:10:161
3368991616,0cyclictest0-21swapper/008:55:140
3374991513,1cyclictest4710-21wc08:20:002
337499150,3cyclictest0-21swapper/207:30:112
3372991513,1cyclictest17863-21sendmail-msp07:40:011
3378991414,0cyclictest0-21swapper/308:55:143
3374991412,1cyclictest0-21swapper/209:05:212
337499140,14cyclictest0-21swapper/207:50:082
337499140,14cyclictest0-21swapper/207:35:462
337499140,14cyclictest0-21swapper/207:15:032
3372991414,0cyclictest0-21swapper/109:00:151
3372991414,0cyclictest0-21swapper/108:23:401
3368991414,0cyclictest0-21swapper/008:10:240
3368991414,0cyclictest0-21swapper/007:20:260
3368991412,1cyclictest0-21swapper/009:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional