You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 17:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Fri Apr 24, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
257399260,25cyclictest25791-21sh09:37:203
2569992523,1cyclictest0-21swapper/207:30:012
256999250,24cyclictest0-21swapper/212:08:452
256999250,0cyclictest0-21swapper/211:00:222
256399250,24cyclictest28740-21diskmemload09:51:520
2573992423,0cyclictest28740-21diskmemload10:55:273
2573992423,0cyclictest0-21swapper/311:38:373
257399240,23cyclictest0-21swapper/312:06:223
257399240,23cyclictest0-21swapper/312:04:493
257399240,23cyclictest0-21swapper/311:56:123
257399240,23cyclictest0-21swapper/311:33:203
257399240,23cyclictest0-21swapper/311:28:133
257399240,1cyclictest0-21swapper/309:45:353
2569992420,4cyclictest4637-21ssh10:50:432
256999240,23cyclictest7682-21ssh09:50:442
2567992423,1cyclictest7095-21ssh11:56:121
256799240,24cyclictest0-21swapper/112:20:071
256799240,24cyclictest0-21swapper/111:37:051
256799240,24cyclictest0-21swapper/110:16:231
256799240,24cyclictest0-21swapper/110:08:461
256799240,23cyclictest28740-21diskmemload10:20:251
256799240,23cyclictest2394-21users09:45:351
256799240,0cyclictest0-21swapper/110:51:481
2563992422,1cyclictest0-21swapper/009:23:300
256399240,24cyclictest28740-21diskmemload12:32:140
256399240,24cyclictest0-21swapper/010:57:570
256399240,23cyclictest28740-21diskmemload12:14:230
256399240,23cyclictest28740-21diskmemload11:18:290
256399240,23cyclictest28740-21diskmemload09:36:210
256399240,23cyclictest14572-21cron07:35:010
2573992323,0cyclictest28740-21diskmemload12:36:443
2573992323,0cyclictest0-21swapper/312:20:463
2573992323,0cyclictest0-21swapper/311:50:373
2573992323,0cyclictest0-21swapper/310:30:483
2573992323,0cyclictest0-21swapper/310:25:523
2573992323,0cyclictest0-21swapper/310:22:033
2573992323,0cyclictest0-21swapper/309:40:423
2573992321,1cyclictest0-21swapper/311:02:233
2573992321,1cyclictest0-21swapper/310:48:183
2573992321,1cyclictest0-21swapper/310:08:553
2573992320,2cyclictest0-21swapper/311:40:253
257399230,23cyclictest28740-21diskmemload10:17:393
257399230,23cyclictest0-21swapper/309:18:163
257399230,0cyclictest28740-21diskmemload10:51:343
257399230,0cyclictest0-21swapper/312:29:123
257399230,0cyclictest0-21swapper/310:43:383
2569992323,0cyclictest28740-21diskmemload12:18:522
2569992323,0cyclictest28740-21diskmemload09:47:262
2569992323,0cyclictest28740-21diskmemload09:38:122
2569992323,0cyclictest0-21swapper/212:12:422
2569992323,0cyclictest0-21swapper/209:25:532
2569992323,0cyclictest0-21swapper/209:12:232
2569992322,1cyclictest28740-21diskmemload11:20:062
2569992322,1cyclictest0-21swapper/212:38:262
2569992320,2cyclictest28740-21diskmemload09:57:272
2569992320,2cyclictest11617-21ssh10:58:422
2569992320,2cyclictest10616-21ssh09:23:232
2569992320,1cyclictest15564-21ssh11:33:482
256999230,23cyclictest0-21swapper/210:18:472
256999230,22cyclictest3102-21ssh12:25:262
256999230,22cyclictest28740-21diskmemload11:35:282
256999230,22cyclictest0-21swapper/210:05:312
256999230,0cyclictest0-21swapper/212:21:012
256999230,0cyclictest0-21swapper/212:01:122
256999230,0cyclictest0-21swapper/211:51:372
256999230,0cyclictest0-21swapper/211:45:302
256999230,0cyclictest0-21swapper/211:08:092
2567992323,0cyclictest0-21swapper/110:40:101
2567992321,2cyclictest760-21sh10:47:421
2567992321,1cyclictest28740-21diskmemload11:04:591
2567992320,2cyclictest28585-21sh11:15:171
256799230,2cyclictest9823-21ssh10:55:441
256799230,23cyclictest0-21swapper/111:10:181
256799230,23cyclictest0-21swapper/110:39:431
256799230,23cyclictest0-21swapper/109:55:441
256799230,23cyclictest0-21swapper/109:31:041
256799230,22cyclictest5224-21apt-get07:15:261
256799230,22cyclictest32012-21ssh11:50:121
256799230,22cyclictest30034-21if_enp1s009:10:281
256799230,22cyclictest22718-21rm09:35:151
256799230,22cyclictest14121-21rm09:25:411
256799230,22cyclictest1290-21rm11:20:131
256799230,1cyclictest13518-21apt-get12:35:021
256799230,0cyclictest28740-21diskmemload10:11:321
256799230,0cyclictest0-21swapper/112:15:381
256799230,0cyclictest0-21swapper/111:47:181
256399233,0cyclictest62550irq/127-eno112:09:470
2563992323,0cyclictest28740-21diskmemload12:25:260
2563992323,0cyclictest28740-21diskmemload12:16:500
2563992323,0cyclictest19844-21apt-get10:35:250
2563992323,0cyclictest0-21swapper/012:03:320
2563992323,0cyclictest0-21swapper/009:40:070
2563992323,0cyclictest0-21swapper/009:11:400
2563992322,0cyclictest0-21swapper/011:35:520
2563992321,1cyclictest0-21swapper/012:23:260
2563992321,1cyclictest0-21swapper/011:56:510
2563992321,1cyclictest0-21swapper/009:59:580
2563992320,2cyclictest16880-21apt09:30:010
256399230,22cyclictest8851-21ssh11:26:150
256399230,22cyclictest4770-21sh11:22:550
256399230,22cyclictest31175-21sh10:45:320
256399230,22cyclictest22897-21memory11:40:310
256399230,22cyclictest17521-21apt-get09:30:020
256399230,22cyclictest0-21swapper/010:05:300
256399230,21cyclictest0-21swapper/009:15:250
256399230,0cyclictest0-21swapper/011:48:290
256399230,0cyclictest0-21swapper/010:27:590
2573992221,1cyclictest0-21swapper/312:15:003
2573992221,1cyclictest0-21swapper/311:48:593
2573992220,1cyclictest0-21swapper/311:16:313
257399220,22cyclictest0-21swapper/312:30:253
257399220,22cyclictest0-21swapper/309:24:123
257399220,21cyclictest331rcuc/307:40:013
257399220,21cyclictest26064-21ssh11:11:383
257399220,21cyclictest0-21swapper/310:03:533
257399220,21cyclictest0-21swapper/309:50:273
257399220,21cyclictest0-21swapper/309:31:003
257399220,21cyclictest0-21swapper/308:45:003
257399220,1cyclictest606-21dbus-daemon08:20:003
257399220,1cyclictest1526-21perf09:15:013
257399220,1cyclictest14568-21cron07:35:013
257399220,1cyclictest0-21swapper/311:07:123
257399220,1cyclictest0-21swapper/310:39:073
257399220,1cyclictest0-21swapper/310:12:033
257399220,1cyclictest0-21swapper/309:25:223
2569992222,0cyclictest28740-21diskmemload11:11:502
2569992222,0cyclictest28740-21diskmemload10:29:022
2569992222,0cyclictest0-21swapper/211:55:102
2569992222,0cyclictest0-21swapper/209:15:322
2569992221,1cyclictest8077-21sh12:30:112
2569992221,1cyclictest30818-21ssh09:42:162
2569992221,1cyclictest0-21swapper/210:46:012
2569992220,1cyclictest8873-21ssh11:26:172
2569992220,1cyclictest24693-21sh10:40:052
2569992220,1cyclictest17089-21sh07:40:012
2569992220,1cyclictest0-21swapper/210:39:082
256999220,21cyclictest9765-21munin-run07:25:002
256999220,21cyclictest29931-21ssh11:15:322
256999220,21cyclictest28740-21diskmemload10:22:322
256999220,21cyclictest27004-21apt-get08:00:262
256999220,21cyclictest16880-21apt-get09:30:022
256999220,21cyclictest0-21swapper/211:40:412
256999220,1cyclictest29129-21ssh10:11:362
2567992222,0cyclictest28740-21diskmemload12:03:001
2567992222,0cyclictest28740-21diskmemload11:28:131
2567992222,0cyclictest0-21swapper/112:26:031
2567992222,0cyclictest0-21swapper/109:20:071
2567992221,1cyclictest11530-21ssh11:30:081
2567992220,2cyclictest19380-21apt-get08:50:021
2567992220,1cyclictest0-21swapper/108:45:231
256799220,2cyclictest4934-21ssh09:17:271
256799220,22cyclictest0-21swapper/110:31:361
256799220,21cyclictest27908-21/usr/sbin/munin09:40:271
256799220,21cyclictest16440-21apt-get10:00:251
256799220,21cyclictest0-21swapper/108:20:001
256799220,1cyclictest20059-21ssh12:10:171
256799220,1cyclictest10331-21/usr/sbin/munin10:25:281
256799220,0cyclictest28740-21diskmemload11:06:311
2563992221,1cyclictest62550irq/127-eno107:10:260
2563992221,1cyclictest0-21swapper/012:35:470
2563992221,0cyclictest0-21swapper/008:45:230
2563992220,1cyclictest11761-21apt-get11:30:260
2563992220,1cyclictest0-21swapper/010:30:460
256399220,21cyclictest0-21swapper/011:10:230
256399220,21cyclictest0-21swapper/011:05:050
256399220,21cyclictest0-21swapper/010:40:170
256399220,21cyclictest0-21swapper/010:20:120
256399220,21cyclictest0-21swapper/010:10:410
256399220,21cyclictest0-21swapper/008:35:250
256399220,21cyclictest0-21swapper/008:20:250
256399220,1cyclictest62550irq/127-eno111:00:020
256399220,1cyclictest19442-21apt-get08:50:250
256399220,1cyclictest0-21swapper/009:48:220
256399220,0cyclictest0-21swapper/010:50:010
2573992120,1cyclictest0-21swapper/309:55:093
2573992119,1cyclictest0-21swapper/307:25:003
257399210,21cyclictest0-21swapper/308:45:233
257399210,20cyclictest29401-21apt-get08:05:253
257399210,20cyclictest0-21swapper/308:50:023
257399210,20cyclictest0-21swapper/308:25:243
257399210,0cyclictest28740-21diskmemload11:20:533
257399210,0cyclictest2830-21apt-get07:10:263
257399210,0cyclictest0-21swapper/308:10:253
2569992121,0cyclictest0-21swapper/210:00:572
256999210,0cyclictest26649-21apt-get09:05:252
256999210,0cyclictest16647-21apt-get08:45:232
256999210,0cyclictest0-21swapper/208:20:252
2567992121,0cyclictest0-21swapper/112:30:251
2567992120,0cyclictest0-21swapper/108:10:251
256799210,21cyclictest28740-21diskmemload09:50:201
256799210,21cyclictest0-21swapper/107:25:251
256799210,20cyclictest0-21swapper/109:05:251
256799210,0cyclictest24257-21apt-get09:00:261
2563992120,0cyclictest0-21swapper/010:00:050
256399210,21cyclictest0-21swapper/011:50:040
256399210,21cyclictest0-21swapper/008:40:260
256399210,0cyclictest0-21swapper/007:50:250
256399210,0cyclictest0-21swapper/007:35:260
2573992020,0cyclictest24589-21apt-get07:55:253
2573992020,0cyclictest0-21swapper/308:00:263
2573992020,0cyclictest0-21swapper/307:45:243
2573992020,0cyclictest0-21swapper/307:25:253
257399200,19cyclictest0-21swapper/309:00:263
257399200,0cyclictest24297-21perf07:55:003
2569992018,1cyclictest26668-21cron08:00:002
2567992020,0cyclictest0-21swapper/108:05:251
2567992020,0cyclictest0-21swapper/108:00:261
256799200,20cyclictest0-21swapper/108:25:241
2563992020,0cyclictest0-21swapper/009:00:260
2563992020,0cyclictest0-21swapper/008:15:250
2563992019,0cyclictest0-21swapper/008:55:250
256399200,0cyclictest0-21swapper/007:15:260
2573991919,0cyclictest0-21swapper/308:35:023
2569991919,0cyclictest0-21swapper/208:35:262
2569991919,0cyclictest0-21swapper/207:40:252
2569991918,0cyclictest0-21swapper/208:15:252
2567991919,0cyclictest14881-21apt-get07:35:261
2567991918,0cyclictest0-21swapper/108:35:261
2567991917,1cyclictest0-21swapper/107:25:001
2563991919,0cyclictest0-21swapper/008:10:260
2563991918,1cyclictest6597-21apt-get08:25:240
2573991818,0cyclictest0-21swapper/307:40:243
2569991818,0cyclictest19442-21apt-get08:50:242
2569991818,0cyclictest0-21swapper/207:20:002
2567991818,0cyclictest0-21swapper/108:40:261
2567991818,0cyclictest0-21swapper/107:55:251
2567991818,0cyclictest0-21swapper/107:45:241
2567991818,0cyclictest0-21swapper/107:10:261
2563991816,1cyclictest8993-21apt-get08:30:250
2573991717,0cyclictest0-21swapper/308:34:273
2569991717,0cyclictest0-21swapper/209:00:262
2569991717,0cyclictest0-21swapper/208:40:262
2569991717,0cyclictest0-21swapper/207:45:242
2567991716,1cyclictest17402-21apt-get07:40:241
2563991716,0cyclictest0-21swapper/008:05:250
2563991714,2cyclictest12208-21munin-run07:30:010
256399170,16cyclictest26682-21cron08:00:000
2573991615,1cyclictest4205-21apt-get08:20:253
2573991615,0cyclictest0-21swapper/307:15:263
2569991616,0cyclictest21841-21apt-get08:55:252
2569991616,0cyclictest0-21swapper/207:10:262
2563991614,1cyclictest21107-21find07:45:310
2569991515,0cyclictest31794-21apt-get08:10:262
2569991513,1cyclictest14594-21latency_hist07:35:012
2569991513,1cyclictest10390-21switchtime08:30:332
2563991515,0cyclictest0-21swapper/007:40:250
257399140,14cyclictest0-21swapper/308:56:063
257399140,0cyclictest0-21swapper/309:06:203
256999140,14cyclictest0-21swapper/208:25:512
256999140,14cyclictest0-21swapper/208:07:072
256999140,0cyclictest0-21swapper/207:50:142
2567991414,0cyclictest0-21swapper/108:55:461
256799140,14cyclictest0-21swapper/107:50:091
2563991414,0cyclictest0-21swapper/009:05:170
2563991414,0cyclictest0-21swapper/008:01:540
256399140,0cyclictest0-21swapper/007:20:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional