You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 21:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 03, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30432993126,2cyclictest34-21ksoftirqd/309:15:003
30432992624,1cyclictest34-21ksoftirqd/307:58:503
30432992622,0cyclictest151rcu_preempt10:46:503
30432992523,1cyclictest0-21swapper/312:39:543
30432992522,2cyclictest11990-21ssh11:51:553
3043299250,24cyclictest28442-21ssh10:11:173
3043299250,24cyclictest0-21swapper/309:59:283
3042999250,24cyclictest0-21swapper/209:25:452
3042999250,22cyclictest0-21swapper/210:50:222
3042399250,24cyclictest10832-21sh11:22:050
3042399250,24cyclictest0-21swapper/012:15:250
30432992420,0cyclictest34-21ksoftirqd/312:26:593
3043299240,23cyclictest9901-21apt-get08:43:483
3043299240,23cyclictest24173-21diskmemload11:32:343
3043299240,23cyclictest24173-21diskmemload09:33:003
3043299240,23cyclictest0-21swapper/312:02:073
3043299240,23cyclictest0-21swapper/310:30:243
30429992419,4cyclictest28003-21ssh09:42:222
3042999240,24cyclictest24173-21diskmemload09:36:522
3042999240,23cyclictest28747-21cat10:40:012
3042999240,23cyclictest0-21swapper/212:21:332
3042999240,23cyclictest0-21swapper/211:46:532
3042999240,23cyclictest0-21swapper/211:38:272
3042999240,23cyclictest0-21swapper/210:34:202
3042999240,1cyclictest24173-21diskmemload11:42:402
30424992424,0cyclictest0-21swapper/110:01:011
30424992423,1cyclictest25088-21rm09:10:501
3042499240,24cyclictest0-21swapper/111:53:331
3042499240,24cyclictest0-21swapper/111:31:211
3042499240,23cyclictest29595-21sh12:35:581
3042499240,1cyclictest4403-21ntp_states12:13:551
3042499240,0cyclictest24173-21diskmemload12:26:101
3042499240,0cyclictest24173-21diskmemload09:25:011
3042499240,0cyclictest16460-21apt-get10:58:501
30423992422,1cyclictest13250-21sh10:27:060
30423992421,2cyclictest607-21in:imuxsock11:00:000
3042399240,24cyclictest24173-21diskmemload11:57:120
3042399240,23cyclictest24173-21diskmemload10:42:070
3042399240,23cyclictest0-21swapper/010:50:340
3042399240,23cyclictest0-21swapper/010:07:550
3042399240,0cyclictest24173-21diskmemload11:04:470
3042399240,0cyclictest0-21swapper/009:22:390
30432992323,0cyclictest24173-21diskmemload10:24:453
30432992323,0cyclictest0-21swapper/311:19:213
30432992323,0cyclictest0-21swapper/309:53:433
30432992322,0cyclictest0-21swapper/312:18:133
30432992321,1cyclictest19407-21sendmail-msp09:00:013
30432992321,1cyclictest0-21swapper/310:40:393
30432992321,1cyclictest0-21swapper/310:36:593
30432992321,1cyclictest0-21swapper/309:23:463
3043299231,1cyclictest3293-21apt-get12:13:493
3043299230,23cyclictest0-21swapper/311:27:153
3043299230,23cyclictest0-21swapper/311:10:483
3043299230,23cyclictest0-21swapper/311:05:393
3043299230,23cyclictest0-21swapper/309:25:473
3043299230,22cyclictest32392-21sh11:40:483
3043299230,22cyclictest24173-21diskmemload11:24:093
3043299230,22cyclictest24173-21diskmemload09:35:163
3043299230,22cyclictest20109-21cron07:55:003
3043299230,22cyclictest0-21swapper/310:18:483
3043299230,22cyclictest0-21swapper/309:49:073
3043299230,1cyclictest24173-21diskmemload12:23:063
3043299230,0cyclictest0-21swapper/311:45:483
30429992323,0cyclictest24173-21diskmemload09:33:142
30429992323,0cyclictest0-21swapper/210:22:002
30429992323,0cyclictest0-21swapper/210:14:092
30429992323,0cyclictest0-21swapper/209:50:172
30429992322,1cyclictest24173-21diskmemload11:12:002
30429992321,1cyclictest0-21swapper/212:35:122
30429992320,2cyclictest22503-21diskmemload10:05:512
30429992320,2cyclictest12829-21sh09:58:002
3042999230,2cyclictest313-21systemd-journal09:10:012
3042999230,23cyclictest0-21swapper/211:53:312
3042999230,23cyclictest0-21swapper/211:15:512
3042999230,23cyclictest0-21swapper/209:45:422
3042999230,22cyclictest750-21ssh12:10:232
3042999230,22cyclictest24173-21diskmemload10:58:422
3042999230,22cyclictest17472-21ssh10:01:382
3042999230,22cyclictest11370-21sh12:19:582
3042999230,0cyclictest30285-21apt-get08:18:482
3042999230,0cyclictest0-21swapper/211:59:012
3042999230,0cyclictest0-21swapper/210:48:482
3042999230,0cyclictest0-21swapper/209:11:002
30424992323,0cyclictest0-21swapper/112:30:111
30424992323,0cyclictest0-21swapper/111:22:381
30424992323,0cyclictest0-21swapper/109:39:081
30424992322,1cyclictest28282-21ssh10:11:051
30424992321,1cyclictest0-21swapper/110:52:571
30424992320,2cyclictest531-21ssh11:41:451
3042499230,23cyclictest0-21swapper/111:27:211
3042499230,23cyclictest0-21swapper/110:27:001
3042499230,23cyclictest0-21swapper/109:56:111
3042499230,23cyclictest0-21swapper/109:51:351
3042499230,23cyclictest0-21swapper/109:40:051
3042499230,22cyclictest24173-21diskmemload12:06:361
3042499230,22cyclictest12903-21munin-plugin-st07:40:001
3042499230,22cyclictest0-21swapper/111:00:201
3042499230,0cyclictest24173-21diskmemload10:06:161
3042499230,0cyclictest0-21swapper/110:47:551
3042499230,0cyclictest0-21swapper/110:41:021
3042499230,0cyclictest0-21swapper/110:32:141
30423992323,0cyclictest0-21swapper/011:10:230
30423992323,0cyclictest0-21swapper/010:15:030
30423992323,0cyclictest0-21swapper/009:30:270
30423992322,1cyclictest0-21swapper/011:25:320
30423992322,1cyclictest0-21swapper/009:56:020
30423992321,1cyclictest32277-21sh09:17:470
30423992321,1cyclictest26162-21apt-get10:38:510
30423992320,2cyclictest25213-21sh12:33:110
30423992320,2cyclictest18811-21sh12:27:040
30423992320,2cyclictest0-21swapper/012:13:300
3042399230,23cyclictest0-21swapper/012:02:590
3042399230,22cyclictest29244-21sh12:35:320
3042399230,22cyclictest14431-21apt09:30:000
3042399230,22cyclictest0-21swapper/010:23:570
3042399230,22cyclictest0-21swapper/009:45:170
3042399230,1cyclictest0-21swapper/011:18:120
3042399230,0cyclictest24173-21diskmemload10:10:390
3042399230,0cyclictest24173-21diskmemload09:41:110
3042399230,0cyclictest0-21swapper/012:21:510
3042399230,0cyclictest0-21swapper/011:50:300
3042399230,0cyclictest0-21swapper/011:31:040
3042399230,0cyclictest0-21swapper/011:08:500
3042399230,0cyclictest0-21swapper/009:12:050
30432992220,1cyclictest606-21dbus-daemon08:20:013
30432992220,1cyclictest0-21swapper/312:06:543
30432992220,1cyclictest0-21swapper/310:55:283
30432992220,1cyclictest0-21swapper/310:50:313
3043299220,21cyclictest24173-21diskmemload10:25:063
3043299220,21cyclictest24173-21diskmemload10:05:133
3043299220,21cyclictest0-21swapper/311:56:593
3043299220,21cyclictest0-21swapper/311:00:583
3043299220,1cyclictest0-21swapper/311:36:393
3043299220,0cyclictest5089-21apt-get08:33:493
3043299220,0cyclictest151rcu_preempt12:34:493
30429992220,1cyclictest0-21swapper/211:00:312
30429992220,1cyclictest0-21swapper/210:25:152
3042999220,21cyclictest24173-21diskmemload12:30:212
3042999220,21cyclictest22387-21rm12:00:502
3042999220,21cyclictest15166-21ssh11:25:192
3042999220,21cyclictest0-21swapper/212:05:402
3042999220,21cyclictest0-21swapper/211:30:342
3042999220,21cyclictest0-21swapper/210:40:142
3042999220,21cyclictest0-21swapper/208:03:492
3042999220,21cyclictest0-21swapper/208:03:492
3042999220,0cyclictest0-21swapper/211:23:252
3042999220,0cyclictest0-21swapper/210:17:462
30424992222,0cyclictest0-21swapper/111:49:481
30424992222,0cyclictest0-21swapper/111:38:591
30424992221,1cyclictest8793-21ssh12:18:451
30424992221,1cyclictest0-21swapper/111:09:051
30424992220,1cyclictest0-21swapper/109:45:111
3042499220,22cyclictest0-21swapper/112:00:461
3042499220,21cyclictest4225-21rm11:15:331
3042499220,21cyclictest3164-21wc07:20:011
3042499220,21cyclictest27347-21perf08:10:011
3042499220,21cyclictest12004-21ssh12:20:241
3042499220,1cyclictest7207-21sh10:21:241
3042499220,1cyclictest5226-21ssh09:22:251
3042499220,1cyclictest4542-21munin-run08:30:001
3042499220,1cyclictest2199-21chrt10:17:101
3042499220,1cyclictest20686-21apt-get07:58:501
3042499220,1cyclictest0-21swapper/109:30:021
3042499220,1cyclictest0-21swapper/109:15:451
3042499220,0cyclictest0-21swapper/110:35:291
30423992220,1cyclictest774-21runrttasks09:50:260
30423992220,1cyclictest317812sleep011:40:010
3042399220,21cyclictest24173-21diskmemload10:45:050
3042399220,21cyclictest0-21swapper/012:05:200
3042399220,21cyclictest0-21swapper/009:36:000
3042399220,21cyclictest0-21swapper/008:53:470
3042399220,21cyclictest0-21swapper/008:50:000
3042399220,21cyclictest0-21swapper/008:18:480
3042399220,1cyclictest62550irq/127-eno110:00:030
3042399220,1cyclictest21989-21kworker/u8:111:45:590
3042399220,1cyclictest0-21swapper/011:35:260
30432992120,1cyclictest27887-21apt-get08:13:473
30432992120,0cyclictest0-21swapper/307:23:493
30432992119,1cyclictest4544-21grep08:30:003
3043299210,21cyclictest0-21swapper/310:00:283
3043299210,20cyclictest24173-21diskmemload09:15:073
3043299210,20cyclictest0-21swapper/308:08:483
3043299210,1cyclictest0-21swapper/307:50:003
30429992121,0cyclictest0-21swapper/209:21:572
30429992121,0cyclictest0-21swapper/209:16:272
30429992120,1cyclictest31009-21apt-get07:10:022
3042999210,20cyclictest0-21swapper/208:58:482
3042999210,1cyclictest23800-1kworker/u9:211:05:522
30424992120,0cyclictest0-21swapper/108:05:011
30424992120,0cyclictest0-21swapper/108:05:011
30424992119,1cyclictest24165-21cron09:10:011
3042499210,21cyclictest0-21swapper/111:10:021
3042499210,0cyclictest0-21swapper/107:28:491
3042399210,20cyclictest0-21swapper/008:58:480
3042399210,20cyclictest0-21swapper/007:38:490
30432992019,1cyclictest0-21swapper/307:13:473
30432992018,1cyclictest8534-21apt-get07:33:493
30429992020,0cyclictest0-21swapper/207:28:492
30429992020,0cyclictest0-21swapper/207:23:492
30429992018,1cyclictest19953-21apt-get09:03:492
3042999200,19cyclictest0-21swapper/207:58:502
3042999200,0cyclictest6936-21latency_hist08:35:002
3042999200,0cyclictest0-21swapper/208:48:502
3042999200,0cyclictest0-21swapper/208:23:482
30424992020,0cyclictest0-21swapper/108:18:481
3042499200,0cyclictest0-21swapper/108:33:491
30423992020,0cyclictest0-21swapper/008:33:490
30423992020,0cyclictest0-21swapper/007:48:480
30423992019,1cyclictest0-21swapper/008:38:460
30423992018,1cyclictest25493-21apt-get08:08:480
30429991919,0cyclictest0-21swapper/208:28:482
30429991919,0cyclictest0-21swapper/208:08:482
30429991919,0cyclictest0-21swapper/207:48:482
30429991919,0cyclictest0-21swapper/207:43:462
30429991919,0cyclictest0-21swapper/207:38:492
30429991919,0cyclictest0-21swapper/207:33:492
30429991918,0cyclictest0-21swapper/208:53:482
30429991917,1cyclictest9369-21awk08:40:002
30424991919,0cyclictest18237-21apt-get07:53:491
30423991919,0cyclictest22348-21apt-get09:08:500
30423991917,1cyclictest0-21swapper/008:03:500
30423991917,1cyclictest0-21swapper/008:03:500
3042399190,18cyclictest0-21swapper/007:20:010
30432991818,0cyclictest0-21swapper/308:03:493
30432991818,0cyclictest0-21swapper/308:03:493
30424991818,0cyclictest13443-21apt-get07:43:461
30423991818,0cyclictest0-21swapper/008:43:480
30423991818,0cyclictest0-21swapper/008:13:470
30423991818,0cyclictest0-21swapper/007:55:000
30423991818,0cyclictest0-21swapper/007:13:470
30432991717,0cyclictest0-21swapper/307:28:493
30424991717,0cyclictest0-21swapper/108:58:481
30423991717,0cyclictest0-21swapper/007:28:490
30423991716,0cyclictest0-21swapper/007:33:490
30423991716,0cyclictest0-21swapper/007:23:490
3042399170,16cyclictest15278-21cron07:45:000
30432991616,0cyclictest0-21swapper/308:48:503
30432991615,0cyclictest11031-21apt-get07:38:493
30432991614,1cyclictest9348-21turbostat08:40:003
3043299160,3cyclictest151rcu_preempt08:53:473
30424991616,0cyclictest0-21swapper/108:48:501
30424991616,0cyclictest0-21swapper/108:23:481
3042399160,15cyclictest3429-21modprobe08:28:510
3043299152,12cyclictest783-21snmpd09:07:183
30432991513,1cyclictest32706-21apt-get08:23:483
3043299150,1cyclictest0-21swapper/307:43:483
30424991514,0cyclictest3738-21apt-get07:23:491
3043299140,0cyclictest0-21swapper/309:00:183
3043299140,0cyclictest0-21swapper/307:15:133
30429991414,0cyclictest0-21swapper/208:40:482
30429991414,0cyclictest0-21swapper/208:10:352
3042999140,14cyclictest0-21swapper/207:16:062
3042999140,0cyclictest0-21swapper/207:50:422
30424991414,0cyclictest0-21swapper/108:36:291
30424991414,0cyclictest0-21swapper/107:30:491
3042499140,14cyclictest0-21swapper/109:00:151
3042499140,14cyclictest0-21swapper/108:51:311
3042499140,14cyclictest0-21swapper/108:10:131
3042499140,14cyclictest0-21swapper/107:45:031
30423991414,0cyclictest0-21swapper/008:20:190
3042399140,14cyclictest0-21swapper/007:59:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional