You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5s.osadl.org (updated Tue Mar 10, 2026 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32165992724,2cyclictest1879-21munin-run08:20:010
32174992621,5cyclictest9379-21ssh09:24:442
3217899250,24cyclictest32187-21cron12:20:013
3217899250,24cyclictest25897-21diskmemload10:55:013
3217899250,24cyclictest14664-21ssh10:00:303
32172992522,2cyclictest28054-21sh11:44:551
3217299250,24cyclictest25897-21diskmemload11:02:331
3217299250,24cyclictest0-21swapper/111:22:351
3216599252,22cyclictest62550irq/127-eno112:25:050
32165992522,2cyclictest0-21swapper/010:17:160
3216599250,24cyclictest3110-21ssh10:50:150
32178992423,1cyclictest25897-21diskmemload10:36:363
32178992423,1cyclictest25897-21diskmemload09:25:053
3217899240,24cyclictest0-21swapper/310:50:593
3217899240,23cyclictest25897-21diskmemload10:17:453
3217899240,23cyclictest0-21swapper/310:24:353
3217899240,1cyclictest25897-21diskmemload12:20:013
3217899240,1cyclictest25897-21diskmemload11:46:213
3217899240,1cyclictest0-21swapper/312:36:253
32174992423,1cyclictest25897-21diskmemload11:10:542
3217499240,23cyclictest25897-21diskmemload10:41:332
3217499240,23cyclictest25897-21diskmemload10:41:332
3217499240,23cyclictest0-21swapper/210:56:392
3217499240,1cyclictest23281-21ssh11:08:552
3217499240,1cyclictest0-21swapper/210:30:482
32172992422,1cyclictest32545-21ptp4l10:46:471
32172992421,2cyclictest605-21avahi-daemon09:05:011
32172992421,2cyclictest16587-21ssh12:36:301
3217299240,24cyclictest20690-21smartctl11:06:411
3217299240,24cyclictest0-21swapper/111:27:141
3217299240,24cyclictest0-21swapper/109:48:401
3217299240,23cyclictest25083-21ssh10:40:181
3217299240,23cyclictest25083-21ssh10:40:181
3217299240,23cyclictest0-21swapper/111:46:161
32165992422,1cyclictest313-21systemd-journal07:25:010
32165992422,1cyclictest31216-21rm11:46:490
3216599240,23cyclictest26111-21sh11:41:490
3216599240,23cyclictest25897-21diskmemload10:55:210
3216599240,23cyclictest25897-21diskmemload09:16:230
3216599240,23cyclictest12479-21memory12:31:460
3216599240,23cyclictest0-21swapper/009:40:510
3216599240,1cyclictest4592-21sh12:24:220
3216599240,0cyclictest0-21swapper/009:20:450
32178992323,0cyclictest25897-21diskmemload12:29:323
32178992323,0cyclictest0-21swapper/312:10:433
32178992323,0cyclictest0-21swapper/311:52:193
32178992323,0cyclictest0-21swapper/311:41:323
32178992323,0cyclictest0-21swapper/311:22:293
32178992323,0cyclictest0-21swapper/309:44:183
32178992321,1cyclictest21335-21ssh09:35:563
3217899230,23cyclictest0-21swapper/310:47:583
3217899230,23cyclictest0-21swapper/309:24:473
3217899230,22cyclictest8059-21ssh11:25:583
3217899230,22cyclictest3442-21ssh09:49:433
3217899230,22cyclictest25897-21diskmemload12:06:093
3217899230,22cyclictest18101-21sh09:31:553
3217899230,22cyclictest0-21swapper/311:55:043
3217899230,22cyclictest0-21swapper/310:11:083
3217899230,0cyclictest0-21swapper/312:00:183
3217899230,0cyclictest0-21swapper/311:38:033
3217899230,0cyclictest0-21swapper/310:42:423
3217899230,0cyclictest0-21swapper/310:42:423
3217899230,0cyclictest0-21swapper/310:25:303
3217899230,0cyclictest0-21swapper/309:51:543
3217899230,0cyclictest0-21swapper/309:10:413
32174992323,0cyclictest0-21swapper/212:05:372
32174992323,0cyclictest0-21swapper/210:16:222
32174992323,0cyclictest0-21swapper/209:51:102
32174992323,0cyclictest0-21swapper/209:46:072
32174992321,1cyclictest0-21swapper/211:50:252
32174992321,1cyclictest0-21swapper/211:36:582
3217499231,21cyclictest0-21swapper/211:56:402
3217499230,2cyclictest27720-21ssh12:15:532
3217499230,23cyclictest0-21swapper/212:10:032
3217499230,23cyclictest0-21swapper/211:46:382
3217499230,23cyclictest0-21swapper/210:28:502
3217499230,23cyclictest0-21swapper/209:40:362
3217499230,22cyclictest25897-21diskmemload09:27:012
3217499230,22cyclictest0-21swapper/211:42:022
3217499230,22cyclictest0-21swapper/211:34:222
3217499230,22cyclictest0-21swapper/211:34:222
3217499230,20cyclictest0-21swapper/212:31:032
3217499230,0cyclictest0-21swapper/212:04:072
3217499230,0cyclictest0-21swapper/210:09:252
32172992323,0cyclictest25897-21diskmemload11:15:541
32172992323,0cyclictest0-21swapper/112:31:151
32172992323,0cyclictest0-21swapper/111:31:341
32172992323,0cyclictest0-21swapper/111:31:341
32172992323,0cyclictest0-21swapper/110:11:021
32172992323,0cyclictest0-21swapper/109:29:361
32172992323,0cyclictest0-21swapper/109:20:031
32172992322,1cyclictest24589-21ssh10:09:321
32172992321,2cyclictest25897-21diskmemload12:11:261
32172992321,1cyclictest9020-21ssh12:28:171
32172992321,1cyclictest0-21swapper/108:45:001
32172992320,2cyclictest2717-21sh10:19:401
32172992320,1cyclictest313-21systemd-journal08:10:001
3217299230,23cyclictest0-21swapper/109:40:211
3217299230,23cyclictest0-21swapper/107:46:381
3217299230,22cyclictest5688-21sh11:54:291
3217299230,22cyclictest4718-21sh10:51:421
3217299230,22cyclictest11997-21ssh12:00:501
3217299230,22cyclictest0-21swapper/112:15:501
3217299230,22cyclictest0-21swapper/111:59:421
3217299230,22cyclictest0-21swapper/109:30:341
3217299230,1cyclictest0-21swapper/109:55:321
3217299230,0cyclictest0-21swapper/111:35:171
3217299230,0cyclictest0-21swapper/110:35:271
3217299230,0cyclictest0-21swapper/110:31:241
3217299230,0cyclictest0-21swapper/109:50:081
3217299230,0cyclictest0-21swapper/109:39:051
3217299230,0cyclictest0-21swapper/109:16:461
32165992323,0cyclictest0-21swapper/009:26:250
32165992322,1cyclictest25897-21diskmemload11:50:080
32165992322,1cyclictest0-21swapper/010:39:280
32165992322,1cyclictest0-21swapper/009:11:230
32165992321,1cyclictest24031-21ssh09:37:290
32165992320,2cyclictest6635-21cron08:30:010
32165992320,2cyclictest31689-21sh09:45:580
3216599230,2cyclictest24216-21rm11:10:040
3216599230,23cyclictest0-21swapper/010:27:010
3216599230,23cyclictest0-21swapper/010:06:230
3216599230,23cyclictest0-21swapper/010:02:170
3216599230,23cyclictest0-21swapper/009:54:490
3216599230,22cyclictest6792-21ssh11:55:450
3216599230,22cyclictest17277-21sh12:05:430
3216599230,22cyclictest0-21swapper/012:39:150
3216599230,22cyclictest0-21swapper/011:35:200
3216599230,1cyclictest31674-21fschecks_count10:46:420
3216599230,0cyclictest25897-21diskmemload11:04:190
3216599230,0cyclictest25897-21diskmemload10:30:190
3216599230,0cyclictest0-21swapper/011:25:210
3216599230,0cyclictest0-21swapper/010:24:370
32178992222,0cyclictest25897-21diskmemload10:30:393
32178992222,0cyclictest0-21swapper/311:05:473
32178992220,1cyclictest4522-21latency_hist07:20:003
32178992220,1cyclictest31826-21kworker/u8:009:55:113
32178992220,1cyclictest0-21swapper/311:15:083
32178992220,1cyclictest0-21swapper/310:06:403
3217899220,21cyclictest25897-21diskmemload09:15:193
3217899220,21cyclictest2089-21awk07:15:003
3217899220,1cyclictest25897-21diskmemload11:32:533
3217899220,1cyclictest25897-21diskmemload11:32:533
3217899220,1cyclictest14477-21ssh12:33:263
3217899220,0cyclictest0-21swapper/311:10:033
32174992222,0cyclictest25897-21diskmemload12:35:052
32174992222,0cyclictest0-21swapper/209:30:492
32174992220,1cyclictest0-21swapper/209:16:552
3217499220,2cyclictest9125-21sh12:28:272
3217499220,21cyclictest7484-21diskmemload11:25:062
3217499220,21cyclictest25897-21diskmemload11:05:002
3217499220,21cyclictest21697-21basename09:36:362
3217499220,21cyclictest0-21swapper/212:20:332
3217499220,21cyclictest0-21swapper/211:15:032
3217499220,21cyclictest0-21swapper/210:50:122
3217499220,21cyclictest0-21swapper/210:37:102
3217499220,21cyclictest0-21swapper/209:11:292
3217499220,1cyclictest19094-21apt-get08:56:382
3217499220,1cyclictest14629-21ssh10:00:272
3217499220,1cyclictest0-21swapper/210:46:592
3217499220,1cyclictest0-21swapper/210:10:102
3217499220,0cyclictest0-21swapper/210:20:152
32172992221,1cyclictest8277-21ssh10:55:161
32172992220,1cyclictest313-21systemd-journal09:00:001
32172992220,1cyclictest0-21swapper/108:35:011
32172992220,1cyclictest0-21swapper/108:01:381
32172992220,1cyclictest0-21swapper/107:25:021
32172992220,1cyclictest0-21swapper/107:25:021
3217299220,21cyclictest25897-21diskmemload11:10:061
3217299220,21cyclictest17798-21ssh12:06:391
3217299220,21cyclictest0-21swapper/110:25:291
3217299220,1cyclictest6193-21sh10:21:571
3217299220,1cyclictest23903-21apt-get09:06:371
3217299220,1cyclictest23903-21apt-get09:06:371
3217299220,1cyclictest0-21swapper/109:10:581
32165992222,0cyclictest0-21swapper/010:11:050
32165992222,0cyclictest0-21swapper/007:16:390
32165992220,1cyclictest0-21swapper/011:30:220
32165992220,1cyclictest0-21swapper/011:30:220
32165992220,1cyclictest0-21swapper/007:35:020
32165992219,2cyclictest27655-21sh12:15:480
3216599220,21cyclictest9059-21perf08:35:010
3216599220,21cyclictest31867-21perf08:15:010
3216599220,21cyclictest0-21swapper/011:20:120
3216599220,1cyclictest24898-21apt-get10:40:020
3216599220,1cyclictest24898-21apt-get10:40:020
3216599220,1cyclictest23670-21ssh11:09:380
3216599220,1cyclictest23537-21munin-run09:05:010
3216599220,1cyclictest16698-21apt-get08:51:370
3216599220,1cyclictest15224-21ssh09:30:070
3216599220,0cyclictest0-21swapper/012:12:000
3216599220,0cyclictest0-21swapper/011:19:020
32178992118,2cyclictest21133-21turbostat09:00:003
3217899210,20cyclictest0-21swapper/307:46:383
32174992121,0cyclictest17849-21apt-get07:46:392
32174992119,1cyclictest11857-21apt-get08:41:382
3217499210,21cyclictest0-21swapper/208:21:382
3217499210,20cyclictest0-21swapper/208:51:372
3217499210,20cyclictest0-21swapper/207:25:022
3217499210,20cyclictest0-21swapper/207:25:022
32172992120,0cyclictest29841-21apt-get08:11:391
32172992119,1cyclictest4904-21apt-get07:21:391
3217299210,20cyclictest0-21swapper/107:16:391
32165992120,1cyclictest0-21swapper/008:56:380
32165992120,1cyclictest0-21swapper/008:41:380
32165992119,1cyclictest27082-21munin-run08:05:000
32178992020,0cyclictest0-21swapper/309:06:373
32178992020,0cyclictest0-21swapper/309:06:373
32178992020,0cyclictest0-21swapper/308:06:383
32178992020,0cyclictest0-21swapper/307:41:373
32178992018,1cyclictest4243-21cron08:25:013
3217899200,19cyclictest6635-21cron08:30:013
3217899200,0cyclictest0-21swapper/307:21:393
3217499200,0cyclictest0-21swapper/208:36:402
3217299200,1cyclictest32497-21apt-get07:11:371
32165992020,0cyclictest0-21swapper/007:51:380
32165992020,0cyclictest0-21swapper/007:41:380
32165992018,1cyclictest9443-21apt-get08:36:400
32165992018,1cyclictest24676-21sendmail-msp08:00:000
32178991919,0cyclictest6920-21apt-get07:25:023
32178991919,0cyclictest6920-21apt-get07:25:023
32174991919,0cyclictest27447-21apt-get08:06:382
32174991919,0cyclictest2483-21apt-get07:16:392
32174991919,0cyclictest0-21swapper/208:16:392
32174991919,0cyclictest0-21swapper/208:11:382
32165991919,0cyclictest0-21swapper/007:46:390
32165991917,1cyclictest0-21swapper/007:35:010
32178991817,0cyclictest0-21swapper/309:01:383
32174991818,0cyclictest15453-21apt-get07:41:382
32174991818,0cyclictest0-21swapper/209:06:372
32174991818,0cyclictest0-21swapper/209:06:372
32174991818,0cyclictest0-21swapper/207:11:372
32174991816,2cyclictest21511-21apt-get09:01:382
32174991816,1cyclictest24647-21sh08:00:002
3217299180,17cyclictest0-21swapper/108:16:431
32165991818,0cyclictest0-21swapper/007:25:020
32165991818,0cyclictest0-21swapper/007:25:020
32165991818,0cyclictest0-21swapper/007:11:370
32178991717,0cyclictest12985-21apt-get07:36:393
32178991717,0cyclictest0-21swapper/308:46:403
32178991717,0cyclictest0-21swapper/308:11:383
32178991716,0cyclictest0-21swapper/308:41:383
32178991616,0cyclictest0-21swapper/308:36:403
32178991616,0cyclictest0-21swapper/307:31:373
32174991616,0cyclictest0-21swapper/207:36:392
3217499160,15cyclictest11787-21awk07:31:462
3217499160,15cyclictest0-21swapper/208:05:002
32172991616,0cyclictest0-21swapper/107:36:391
32174991515,0cyclictest0-21swapper/208:26:392
32165991515,0cyclictest0-21swapper/008:06:380
3216599150,15cyclictest29987-21munin-node08:47:360
32178991414,0cyclictest0-21swapper/308:50:023
32178991414,0cyclictest0-21swapper/308:16:293
3217899140,14cyclictest0-21swapper/308:30:453
3217899140,14cyclictest0-21swapper/307:51:353
3217899140,0cyclictest0-21swapper/308:00:113
3217899140,0cyclictest0-21swapper/307:55:473
3217499140,14cyclictest0-21swapper/208:30:102
3217499140,14cyclictest0-21swapper/207:50:272
3217499140,14cyclictest0-21swapper/207:20:342
3217499140,0cyclictest0-21swapper/208:45:212
32172991414,0cyclictest0-21swapper/108:35:281
32172991414,0cyclictest0-21swapper/108:20:251
32172991414,0cyclictest0-21swapper/107:51:051
3217299140,14cyclictest0-21swapper/108:45:211
3217299140,14cyclictest0-21swapper/108:25:051
3217299140,14cyclictest0-21swapper/107:56:021
3217299140,14cyclictest0-21swapper/107:40:211
3217299140,14cyclictest0-21swapper/107:30:511
3216599140,14cyclictest0-21swapper/009:05:280
3216599140,14cyclictest0-21swapper/009:05:280
3216599140,0cyclictest0-21swapper/008:20:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional