You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-04 - 00:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu Sep 03, 2026 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3020199250,24cyclictest0-21swapper/210:10:452
30200992524,1cyclictest0-21swapper/111:26:551
30200992523,1cyclictest0-21swapper/112:22:171
3020099250,24cyclictest0-21swapper/111:13:421
30199992523,2cyclictest14752-21sh11:54:310
30199992523,1cyclictest62550irq/127-eno109:50:480
3019999250,24cyclictest23971-21diskmemload12:38:400
3019999250,1cyclictest23971-21diskmemload10:10:450
3020299240,24cyclictest23971-21diskmemload10:25:213
3020299240,24cyclictest0-21swapper/311:55:123
3020299240,24cyclictest0-21swapper/311:40:223
3020299240,1cyclictest23971-21diskmemload10:31:583
3020299240,0cyclictest0-21swapper/311:35:313
3020299240,0cyclictest0-21swapper/309:11:233
30201992423,1cyclictest7796-21ssh09:51:362
30201992422,1cyclictest23971-21diskmemload09:38:272
3020199240,2cyclictest15045-21ssh09:58:552
3020199240,24cyclictest0-21swapper/210:54:132
3020199240,23cyclictest0-21swapper/212:00:492
3020199240,23cyclictest0-21swapper/210:05:072
3020199240,23cyclictest0-21swapper/209:11:342
3020199240,1cyclictest6174-21apt-get12:16:262
3020199240,1cyclictest23971-21diskmemload11:25:402
30200992424,0cyclictest0-21swapper/111:52:101
30200992423,1cyclictest23971-21diskmemload10:44:251
30200992423,1cyclictest0-21swapper/112:06:111
30200992423,1cyclictest0-21swapper/111:45:421
30200992423,1cyclictest0-21swapper/110:23:581
30200992422,1cyclictest0-21swapper/111:43:011
30200992422,1cyclictest0-21swapper/110:01:221
3020099240,23cyclictest22566-21ssh10:06:211
3020099240,1cyclictest17540-21awk07:50:011
3020099240,0cyclictest0-21swapper/112:38:401
3020099240,0cyclictest0-21swapper/110:54:131
3020099240,0cyclictest0-21swapper/109:51:361
30199992424,0cyclictest0-21swapper/011:26:550
30199992424,0cyclictest0-21swapper/009:25:330
30199992423,1cyclictest0-21swapper/011:45:420
30199992423,0cyclictest0-21swapper/010:01:220
3019999240,24cyclictest0-21swapper/010:38:300
3019999240,23cyclictest23971-21diskmemload12:08:250
3019999240,23cyclictest23971-21diskmemload10:47:130
3019999240,23cyclictest0-21swapper/012:24:020
3019999240,23cyclictest0-21swapper/011:32:150
30202992323,0cyclictest23971-21diskmemload10:02:543
30202992323,0cyclictest0-21swapper/312:26:303
30202992323,0cyclictest0-21swapper/312:20:593
30202992323,0cyclictest0-21swapper/311:49:153
30202992323,0cyclictest0-21swapper/311:16:173
30202992320,2cyclictest313-21systemd-journal07:25:003
30202992320,2cyclictest13601-21sh10:55:333
30202992320,2cyclictest13601-21sh10:55:333
3020299230,23cyclictest0-21swapper/311:13:373
3020299230,23cyclictest0-21swapper/310:07:083
3020299230,22cyclictest9080-21sh10:21:593
3020299230,22cyclictest23971-21diskmemload12:05:123
3020299230,22cyclictest23971-21diskmemload11:54:103
3020299230,22cyclictest22498-21ssh12:01:213
3020299230,22cyclictest18002-21sh11:28:093
3020299230,0cyclictest23971-21diskmemload11:34:283
3020299230,0cyclictest0-21swapper/311:05:213
3020299230,0cyclictest0-21swapper/311:00:503
30201992323,0cyclictest23971-21diskmemload11:32:152
30201992323,0cyclictest0-21swapper/209:40:252
30201992322,1cyclictest2571-1kworker/u9:209:25:332
30201992322,0cyclictest0-21swapper/210:47:132
30201992321,1cyclictest3790-21ssh12:13:232
30201992321,1cyclictest17115-21apt-get10:01:222
30201992321,1cyclictest0-21swapper/211:54:312
3020199230,2cyclictest8612-21rm11:20:122
3020199230,23cyclictest0-21swapper/211:12:272
3020199230,23cyclictest0-21swapper/211:06:312
3020199230,23cyclictest0-21swapper/211:02:582
3020199230,23cyclictest0-21swapper/210:56:362
3020199230,23cyclictest0-21swapper/210:56:362
3020199230,22cyclictest3652-21ssh10:17:082
3020199230,22cyclictest31798-21ssh09:45:132
3020199230,22cyclictest31323-21ssh12:37:182
3020199230,22cyclictest30186-21ssh12:07:392
3020199230,22cyclictest17539-21perf07:50:012
3020199230,22cyclictest12747-21perf07:40:002
3020199230,22cyclictest11786-21apt-get12:21:222
3020199230,1cyclictest28442-21diskmemload11:36:472
3020199230,0cyclictest0-21swapper/212:25:542
3020199230,0cyclictest0-21swapper/209:15:342
30200992323,0cyclictest0-21swapper/112:13:391
30200992323,0cyclictest0-21swapper/109:25:331
30200992323,0cyclictest0-21swapper/109:13:351
30200992322,1cyclictest23971-21diskmemload10:46:141
30200992321,1cyclictest0-21swapper/111:56:171
30200992321,1cyclictest0-21swapper/111:20:321
30200992321,1cyclictest0-21swapper/109:21:041
30200992321,1cyclictest0-21swapper/109:21:041
30200992321,1cyclictest0-21swapper/109:15:181
3020099230,23cyclictest0-21swapper/111:15:581
3020099230,23cyclictest0-21swapper/109:38:271
3020099230,22cyclictest19208-21apt09:00:001
3020099230,22cyclictest17249-21ssh12:25:341
3020099230,22cyclictest12551-21apt-get10:55:011
3020099230,22cyclictest12551-21apt-get10:55:011
3020099230,22cyclictest0-21swapper/111:01:201
3020099230,22cyclictest0-21swapper/110:35:131
3020099230,22cyclictest0-21swapper/110:13:031
3020099230,1cyclictest0-21swapper/109:49:151
3020099230,0cyclictest0-21swapper/112:30:401
3020099230,0cyclictest0-21swapper/112:30:401
3020099230,0cyclictest0-21swapper/111:32:151
3020099230,0cyclictest0-21swapper/109:40:251
30199992323,0cyclictest23971-21diskmemload12:13:390
30199992323,0cyclictest0-21swapper/012:00:470
30199992323,0cyclictest0-21swapper/011:06:310
30199992323,0cyclictest0-21swapper/010:23:580
30199992323,0cyclictest0-21swapper/009:23:220
30199992323,0cyclictest0-21swapper/009:23:220
30199992322,1cyclictest0-21swapper/012:25:190
30199992322,1cyclictest0-21swapper/010:07:410
30199992321,1cyclictest0-21swapper/011:57:140
30199992321,1cyclictest0-21swapper/010:43:310
30199992321,1cyclictest0-21swapper/009:18:100
3019999231,21cyclictest32316-21apt-get08:21:210
3019999230,23cyclictest0-21swapper/012:30:400
3019999230,23cyclictest0-21swapper/012:30:400
3019999230,23cyclictest0-21swapper/011:15:580
3019999230,23cyclictest0-21swapper/010:34:320
3019999230,23cyclictest0-21swapper/009:38:160
3019999230,23cyclictest0-21swapper/009:31:080
3019999230,22cyclictest2664-21munin-run11:15:010
3019999230,22cyclictest21991-21sh11:02:140
3019999230,22cyclictest19205-21sendmail-msp09:00:000
3019999230,22cyclictest11502-21sh09:56:230
3019999230,1cyclictest0-21swapper/010:17:080
3019999230,1cyclictest0-21swapper/009:45:130
3019999230,0cyclictest0-21swapper/011:40:090
3019999230,0cyclictest0-21swapper/010:29:170
3019999230,0cyclictest0-21swapper/009:40:250
3019999230,0cyclictest0-21swapper/009:10:290
30202992222,0cyclictest23971-21diskmemload12:34:333
30202992222,0cyclictest23971-21diskmemload12:34:333
30202992222,0cyclictest0-21swapper/310:54:463
30202992222,0cyclictest0-21swapper/310:48:233
30202992222,0cyclictest0-21swapper/309:55:273
30202992221,0cyclictest1348-21apt-get10:16:263
30202992220,1cyclictest28842-21ssh12:36:123
3020299220,21cyclictest9148-21rm09:25:033
3020299220,21cyclictest5581-21ssh09:51:013
3020299220,21cyclictest23971-21diskmemload09:41:413
3020299220,21cyclictest0-21swapper/309:45:103
3020299220,1cyclictest8972-21ssh12:17:473
3020299220,1cyclictest4724-21sh09:21:213
3020299220,1cyclictest4724-21sh09:21:213
3020299220,1cyclictest32034-21ssh10:14:263
3020299220,1cyclictest23971-21diskmemload09:35:363
3020299220,1cyclictest1517-21munin-run10:45:003
3020299220,1cyclictest0-21swapper/309:31:303
3020299220,0cyclictest14617-21apt-get08:50:023
30201992222,0cyclictest23971-21diskmemload12:30:402
30201992222,0cyclictest23971-21diskmemload12:30:402
30201992222,0cyclictest0-21swapper/211:40:092
30201992222,0cyclictest0-21swapper/211:15:582
30201992222,0cyclictest0-21swapper/209:20:362
30201992222,0cyclictest0-21swapper/209:20:362
30201992220,1cyclictest30546-21apt-get07:11:222
30201992220,1cyclictest18696-21ssh11:57:142
3020199220,22cyclictest0-21swapper/209:30:392
3020199220,21cyclictest6954-21apt-get10:21:222
3020199220,21cyclictest0-21swapper/210:30:502
3020199220,1cyclictest5023-21ssh11:46:102
3020199220,0cyclictest0-21swapper/210:38:352
30200992222,0cyclictest0-21swapper/112:16:411
30200992220,1cyclictest0-21swapper/111:35:021
3020099220,22cyclictest0-21swapper/109:31:141
3020099220,21cyclictest0-21swapper/111:06:011
3020099220,21cyclictest0-21swapper/110:31:031
3020099220,21cyclictest0-21swapper/110:25:121
3020099220,1cyclictest606-21dbus-daemon07:40:001
3020099220,1cyclictest23971-21diskmemload09:55:351
3020099220,1cyclictest23633-21sh12:01:281
30199992221,1cyclictest0-21swapper/011:20:020
30199992221,0cyclictest23971-21diskmemload10:50:180
30199992219,2cyclictest27125-21idleruntime-cro08:10:000
3019999220,21cyclictest27495-21apt-get08:11:210
3019999220,1cyclictest13192-21ssh10:55:010
3019999220,1cyclictest13192-21ssh10:55:010
3019999220,1cyclictest12758-21cut07:40:000
3019999220,1cyclictest0-21swapper/011:39:010
30202992121,0cyclictest0-21swapper/311:20:193
30202992121,0cyclictest0-21swapper/310:35:013
30202992121,0cyclictest0-21swapper/309:16:233
30202992120,1cyclictest13992-21awk08:50:013
30202992119,1cyclictest0-21swapper/308:21:213
30202992118,2cyclictest17541-21latency_hist07:50:013
3020299210,21cyclictest32400-21ssh12:10:323
3020299210,21cyclictest31961-21perf08:20:003
30201992119,1cyclictest0-21swapper/208:30:002
3020199210,20cyclictest23971-21diskmemload10:25:022
3020199210,20cyclictest22707-21apt-get08:01:192
3020199210,20cyclictest0-21swapper/208:36:202
3020199210,0cyclictest0-21swapper/207:21:212
30200992121,0cyclictest0-21swapper/108:11:201
30200992120,1cyclictest4995-21apt-get07:25:021
30200992119,1cyclictest27110-21cron08:10:001
3020099210,0cyclictest0-21swapper/108:21:211
3019999210,20cyclictest15503-21apt-get07:46:210
3019999210,0cyclictest7094-21apt-get08:36:200
30202992020,0cyclictest0-21swapper/308:36:203
30202992020,0cyclictest0-21swapper/307:25:023
3020299200,19cyclictest0-21swapper/308:56:223
3020299200,0cyclictest13110-21apt-get07:41:213
3020299200,0cyclictest0-21swapper/308:06:223
30201992020,0cyclictest0-21swapper/208:11:212
30201992020,0cyclictest0-21swapper/207:51:212
3020199200,0cyclictest0-21swapper/207:41:222
30200992019,0cyclictest0-21swapper/109:06:211
3020099200,19cyclictest19561-21apt-get09:01:211
30199992020,0cyclictest0-21swapper/007:25:020
30199992019,1cyclictest14751-21apt-get08:51:210
30202991919,0cyclictest9568-21apt-get08:41:203
30202991918,0cyclictest0-21swapper/308:11:213
30201991918,1cyclictest0-21swapper/207:25:022
30201991917,1cyclictest27128-21cron08:10:002
30200991919,0cyclictest0-21swapper/108:36:211
30199991919,0cyclictest0-21swapper/009:06:210
30199991919,0cyclictest0-21swapper/007:21:210
30199991916,2cyclictest4331-21latency_hist08:30:000
3019999190,18cyclictest0-21swapper/008:01:190
30202991816,1cyclictest12745-21idleruntime-cro07:40:003
30201991818,0cyclictest0-21swapper/208:21:212
30200991818,0cyclictest0-21swapper/108:51:211
30200991818,0cyclictest0-21swapper/107:21:211
3020099180,0cyclictest0-21swapper/108:01:191
30199991818,0cyclictest0-21swapper/009:01:210
30199991816,1cyclictest0-21swapper/008:41:210
30202991717,0cyclictest0-21swapper/308:26:223
30202991717,0cyclictest0-21swapper/307:11:213
30202991716,1cyclictest0-21swapper/308:01:193
3020299170,16cyclictest20293-21apt-get07:56:223
30201991717,0cyclictest0-21swapper/209:06:212
30201991717,0cyclictest0-21swapper/208:51:212
30201991716,1cyclictest0-21swapper/209:01:212
3020199170,0cyclictest0-21swapper/208:41:212
30200991717,0cyclictest20293-21apt-get07:56:221
30200991715,1cyclictest4325-21dump-pmu-power08:30:001
30200991715,1cyclictest0-21swapper/108:41:211
30199991717,0cyclictest0-21swapper/007:56:220
3020299160,15cyclictest19979-21sed07:55:013
30200991616,0cyclictest0-21swapper/107:11:211
30200991615,0cyclictest0-21swapper/107:16:221
30200991614,2cyclictest10277-21latency_hist07:35:001
30199991616,0cyclictest0-21swapper/007:11:210
30199991614,1cyclictest0-21swapper/008:16:200
30202991515,0cyclictest0-21swapper/307:16:223
3020299150,1cyclictest5747-21ntp_states08:31:273
30201991515,0cyclictest0-21swapper/207:56:222
30201991514,1cyclictest480-21apt-get07:16:222
3020199150,1cyclictest5601-21memory08:31:252
3020199150,14cyclictest0-21swapper/208:58:362
30199991515,0cyclictest0-21swapper/007:16:220
30202991414,0cyclictest0-21swapper/309:00:063
3020299140,14cyclictest0-21swapper/309:06:173
3020299140,0cyclictest0-21swapper/307:30:433
3020199140,14cyclictest0-21swapper/208:15:132
3020199140,14cyclictest0-21swapper/207:30:262
3020199140,0cyclictest0-21swapper/208:46:152
30200991414,0cyclictest0-21swapper/107:40:151
3020099140,14cyclictest0-21swapper/108:30:181
3020099140,0cyclictest0-21swapper/108:15:031
3020099140,0cyclictest0-21swapper/107:50:071
30199991414,0cyclictest0-21swapper/007:40:150
3019999140,14cyclictest0-21swapper/008:45:120
3019999140,14cyclictest0-21swapper/008:30:180
3019999140,14cyclictest0-21swapper/007:30:110
3019999140,0cyclictest0-21swapper/007:50:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional