You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 00:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Fri Dec 05, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
194642122101,16sleep30-21swapper/307:09:523
19428212095,20sleep00-21swapper/007:09:240
19323211896,16sleep10-21swapper/107:08:051
19474211796,16sleep20-21swapper/207:09:592
131372830,0sleep30-21swapper/311:27:473
253022770,0sleep20-21swapper/209:21:472
275692740,0sleep10-21swapper/109:25:071
275692740,0sleep10-21swapper/109:25:071
101262720,1sleep00-21swapper/008:55:000
19506994527,16cyclictest0-21swapper/211:00:122
19505993415,18cyclictest0-21swapper/108:55:091
254782250,1sleep3381ktimersoftd/309:56:323
23252250,0sleep20-21swapper/209:32:012
1950499231,20cyclictest24222-21ssh12:15:130
1950799220,20cyclictest0-21swapper/309:30:133
222462210,1sleep30-21swapper/309:53:513
1950799210,19cyclictest0-21swapper/310:20:113
1950499210,19cyclictest0-21swapper/010:20:100
1950799200,2cyclictest0-21swapper/310:35:133
1950799200,19cyclictest0-21swapper/310:30:123
1950599200,15cyclictest0-21swapper/110:12:051
1950499200,18cyclictest0-21swapper/009:15:110
1950499190,2cyclictest0-21swapper/011:25:110
19505991815,2cyclictest31930-21kworker/u8:210:39:051
19505991815,2cyclictest17532-21kworker/u8:309:56:011
19505991714,2cyclictest3317-21kworker/u8:011:20:051
19505991714,2cyclictest31830-21kworker/u8:108:05:051
19505991714,2cyclictest26012-21kworker/u8:212:16:051
19505991714,2cyclictest25971-21kworker/u8:109:31:051
1950599171,14cyclictest5874-21munin-node1
1950799160,3cyclictest0-21swapper/309:20:443
1950799160,14cyclictest4126-21grep08:25:133
1950799160,14cyclictest0-21swapper/309:36:233
19505991613,2cyclictest25560-21kworker/u8:111:10:051
19505991613,2cyclictest19467-21kworker/u8:112:24:041
19505991611,3cyclictest22116-21sendmail07:20:001
19504991611,3cyclictest9680-21copy10:49:590
1950799153,8cyclictest13293-21diskmemload11:45:253
1950799151,12cyclictest787-21apt-get11:15:123
1950799151,12cyclictest13480-21ssh12:37:503
1950799150,2cyclictest13293-21diskmemload12:25:133
1950799150,13cyclictest0-21swapper/312:14:493
1950799150,13cyclictest0-21swapper/311:39:433
1950799150,13cyclictest0-21swapper/309:18:543
1950699151,12cyclictest23125-21ssh11:39:042
19506991511,2cyclictest13293-21diskmemload12:02:582
19506991510,3cyclictest0-21swapper/211:18:272
1950699150,2cyclictest0-21swapper/211:25:112
1950699150,13cyclictest13293-21diskmemload09:11:582
1950699150,13cyclictest0-21swapper/210:41:382
1950699150,13cyclictest0-21swapper/208:40:252
19505991512,2cyclictest6552-21kworker/u8:210:16:021
19505991512,2cyclictest6552-21kworker/u8:210:06:051
19505991512,2cyclictest6552-21kworker/u8:209:38:041
19505991512,2cyclictest30918-21kworker/u8:211:16:051
19505991512,2cyclictest30243-21kworker/u8:111:48:051
19505991512,2cyclictest22843-21kworker/u8:011:55:051
19505991512,2cyclictest21204-21kworker/u8:209:21:051
19505991512,2cyclictest10375-21kworker/u8:009:16:041
1950599150,2cyclictest16472-21kworker/u8:110:27:051
1950599150,2cyclictest0-21swapper/111:50:161
1950499151,12cyclictest19256-21apt-get11:00:120
1950499150,13cyclictest0-21swapper/010:10:120
1950499150,13cyclictest0-21swapper/009:45:230
1950499150,13cyclictest0-21swapper/009:45:220
1950799149,3cyclictest6719-21ssh10:10:503
1950799142,8cyclictest13293-21diskmemload12:05:003
1950799142,6cyclictest0-21swapper/307:39:593
1950799141,7cyclictest0-21swapper/308:20:003
19507991411,2cyclictest3032-21copy08:20:043
19507991411,2cyclictest0-21swapper/310:01:033
1950799141,11cyclictest13050-21ssh10:53:003
19507991410,2cyclictest0-21swapper/312:15:343
1950799140,2cyclictest0-21swapper/312:07:133
1950799140,2cyclictest0-21swapper/311:51:333
1950799140,2cyclictest0-21swapper/310:42:123
1950799140,2cyclictest0-21swapper/310:27:533
1950799140,2cyclictest0-21swapper/309:13:323
1950799140,13cyclictest0-21swapper/311:08:223
1950799140,12cyclictest0-21swapper/311:42:573
1950799140,12cyclictest0-21swapper/311:11:213
1950799140,12cyclictest0-21swapper/311:03:393
1950799140,12cyclictest0-21swapper/310:06:033
1950699149,3cyclictest15975-21ssh10:20:432
1950699149,3cyclictest0-21swapper/209:45:122
1950699149,3cyclictest0-21swapper/209:45:112
1950699142,7cyclictest0-21swapper/207:30:002
1950699142,6cyclictest0-21swapper/208:54:592
1950699142,6cyclictest0-21swapper/208:25:002
1950699142,6cyclictest0-21swapper/208:04:592
19506991411,2cyclictest13293-21diskmemload09:53:382
19506991411,2cyclictest0-21swapper/211:59:472
19506991411,2cyclictest0-21swapper/211:32:172
19506991411,2cyclictest0-21swapper/209:44:482
19506991410,2cyclictest0-21swapper/212:10:062
19506991410,2cyclictest0-21swapper/210:01:452
1950699140,3cyclictest21666-21sed07:15:002
1950699140,2cyclictest0-21swapper/211:14:382
1950699140,2cyclictest0-21swapper/210:07:572
1950699140,13cyclictest0-21swapper/212:20:072
1950699140,13cyclictest0-21swapper/210:38:282
1950699140,12cyclictest8323-21ssh12:31:592
1950699140,12cyclictest10275-21munin-node2
1950699140,12cyclictest0-21swapper/212:35:092
1950699140,12cyclictest0-21swapper/212:25:562
1950699140,12cyclictest0-21swapper/212:15:542
1950699140,12cyclictest0-21swapper/211:50:482
1950699140,12cyclictest0-21swapper/211:48:022
1950699140,12cyclictest0-21swapper/211:21:362
1950699140,12cyclictest0-21swapper/211:07:002
1950599142,6cyclictest0-21swapper/108:50:001
19505991411,2cyclictest7986-21kworker/u8:312:04:021
19505991411,2cyclictest6552-21kworker/u8:210:03:051
19505991411,2cyclictest3317-21kworker/u8:011:26:061
19505991411,2cyclictest31930-21kworker/u8:210:41:041
19505991411,2cyclictest25971-21kworker/u8:109:46:061
19505991411,2cyclictest25971-21kworker/u8:109:46:061
19505991411,2cyclictest25560-21kworker/u8:111:36:061
19505991411,2cyclictest16472-21kworker/u8:111:00:051
19505991411,2cyclictest16472-21kworker/u8:110:57:041
1950599140,13cyclictest0-21swapper/107:10:171
19504991411,2cyclictest0-21swapper/011:05:270
19504991411,2cyclictest0-21swapper/010:25:270
19504991411,2cyclictest0-21swapper/009:27:200
19504991411,2cyclictest0-21swapper/009:27:190
19504991410,2cyclictest15692-21pzem_energy10:55:210
1950499140,2cyclictest0-21swapper/012:20:120
1950499140,2cyclictest0-21swapper/011:35:160
1950499140,13cyclictest0-21swapper/011:53:170
1950499140,13cyclictest0-21swapper/011:47:260
1950499140,12cyclictest8393-21ssh09:39:070
1950499140,12cyclictest0-21swapper/012:05:210
1950499140,12cyclictest0-21swapper/012:03:410
1950499140,12cyclictest0-21swapper/009:21:590
54162130,2sleep00-21swapper/011:55:030
1950799138,3cyclictest0-21swapper/307:50:003
19507991310,2cyclictest0-21swapper/312:21:133
19507991310,2cyclictest0-21swapper/311:55:013
19507991310,2cyclictest0-21swapper/309:40:123
19507991310,2cyclictest0-21swapper/308:05:083
1950799130,2cyclictest0-21swapper/312:30:203
1950799130,2cyclictest0-21swapper/310:45:183
1950799130,2cyclictest0-21swapper/310:18:273
1950799130,12cyclictest0-21swapper/309:26:523
1950799130,12cyclictest0-21swapper/309:26:513
1950799130,11cyclictest13293-21diskmemload10:55:023
1950799130,11cyclictest0-21swapper/311:21:283
1950699131,7cyclictest0-21swapper/208:00:002
19506991310,2cyclictest13293-21diskmemload10:45:362
19506991310,2cyclictest0-21swapper/210:50:062
19506991310,2cyclictest0-21swapper/210:28:102
19506991310,2cyclictest0-21swapper/210:11:172
19506991310,2cyclictest0-21swapper/209:59:152
19506991310,2cyclictest0-21swapper/209:19:232
1950699130,2cyclictest11511-21ssh10:16:042
1950699130,2cyclictest0-21swapper/212:05:212
1950699130,2cyclictest0-21swapper/211:40:222
1950699130,2cyclictest0-21swapper/210:57:532
1950699130,12cyclictest0-21swapper/209:35:092
1950699130,11cyclictest13293-21diskmemload10:31:592
1950599138,3cyclictest11277-21timerandwakeup10:50:261
1950599133,3cyclictest28495-21cut11:10:001
1950599132,6cyclictest0-21swapper/109:05:001
19505991310,2cyclictest6552-21kworker/u8:209:54:051
19505991310,2cyclictest394-21kworker/u8:008:37:051
19505991310,2cyclictest27937-21kworker/u8:207:54:001
19505991310,2cyclictest22566-21kworker/u8:107:36:041
19505991310,2cyclictest22566-21kworker/u8:107:33:051
19505991310,2cyclictest1187-21kworker/u8:012:31:051
19505991310,2cyclictest0-21swapper/112:06:161
19505991310,2cyclictest0-21swapper/109:12:561
1950599130,2cyclictest0-21swapper/112:35:041
1950599130,12cyclictest0-21swapper/111:32:261
1950599130,12cyclictest0-21swapper/107:40:221
19504991310,2cyclictest0-21swapper/012:11:010
19504991310,2cyclictest0-21swapper/011:20:190
19504991310,2cyclictest0-21swapper/011:10:320
19504991310,2cyclictest0-21swapper/010:09:140
19504991310,2cyclictest0-21swapper/009:51:220
19504991310,2cyclictest0-21swapper/009:12:400
19504991310,2cyclictest0-21swapper/007:15:000
1950499130,2cyclictest13293-21diskmemload10:42:000
1950499130,2cyclictest0-21swapper/012:25:270
1950499130,2cyclictest0-21swapper/011:43:020
1950499130,2cyclictest0-21swapper/010:53:020
1950499130,2cyclictest0-21swapper/010:17:070
1950499130,2cyclictest0-21swapper/010:02:530
1950499130,2cyclictest0-21swapper/009:32:070
1950499130,12cyclictest0-21swapper/011:16:290
1950499130,12cyclictest0-21swapper/010:30:120
155702130,0sleep30-21swapper/309:45:333
155702130,0sleep30-21swapper/309:45:323
120102130,1sleep00-21swapper/009:42:230
274832120,2sleep10-21swapper/110:34:181
1950799129,2cyclictest0-21swapper/311:30:503
1950799122,6cyclictest0-21swapper/308:50:003
1950699122,7cyclictest0-21swapper/209:08:592
1950699122,7cyclictest0-21swapper/209:01:022
1950699122,7cyclictest0-21swapper/208:45:022
1950699122,7cyclictest0-21swapper/208:36:592
1950699122,7cyclictest0-21swapper/207:21:022
1950699120,11cyclictest0-21swapper/209:25:192
1950699120,11cyclictest0-21swapper/209:25:192
1950599129,2cyclictest6552-21kworker/u8:210:24:041
1950599129,2cyclictest27937-21kworker/u8:207:57:041
1950599129,2cyclictest22843-21kworker/u8:012:10:041
1950599129,2cyclictest22835-21kworker/u8:207:21:041
1950599122,6cyclictest13293-21diskmemload12:25:011
1950599121,9cyclictest4375-21iostat08:25:151
1950599121,9cyclictest2808-21apt-get08:20:061
1950599121,9cyclictest0-21swapper/107:50:001
1950599121,3cyclictest0-21swapper/108:40:241
1950599120,2cyclictest13293-21diskmemload09:40:231
1950599120,10cyclictest0-21swapper/108:10:201
1950499129,2cyclictest0-21swapper/010:35:420
1950499129,2cyclictest0-21swapper/009:57:200
1950499122,7cyclictest0-21swapper/007:48:020
1950499120,2cyclictest0-21swapper/008:20:030
1950499120,11cyclictest0-21swapper/012:37:410
1950499120,11cyclictest0-21swapper/012:33:300
1950499120,11cyclictest0-21swapper/011:31:330
1950499120,11cyclictest0-21swapper/008:25:140
1950499120,10cyclictest22826-21latency_hist07:25:000
1950799118,2cyclictest0-21swapper/308:10:183
1950799118,2cyclictest0-21swapper/307:10:233
1950799112,6cyclictest0-21swapper/308:55:213
1950699116,3cyclictest26880-21ethtool07:40:142
1950699116,3cyclictest26009-21sh07:40:002
1950599118,2cyclictest394-21kworker/u8:008:33:051
1950599118,2cyclictest31830-21kworker/u8:108:15:041
1950599118,2cyclictest22843-21kworker/u8:011:43:051
1950599118,2cyclictest22566-21kworker/u8:107:27:041
1950599118,2cyclictest10375-21kworker/u8:009:08:051
1950599112,5cyclictest0-21swapper/108:49:591
1950599110,8cyclictest0-21swapper/108:03:591
1950499118,2cyclictest0-21swapper/008:55:140
1950499118,2cyclictest0-21swapper/007:40:100
1950499117,2cyclictest24844-21cat07:30:000
1950499111,5cyclictest0-21swapper/008:19:590
1950799105,3cyclictest24203-21timerwakeupswit07:25:253
1950799105,3cyclictest12685-21sh09:04:593
1950799102,6cyclictest0-21swapper/308:40:003
1950799102,6cyclictest0-21swapper/307:40:223
1950699105,3cyclictest2804-21sh08:20:002
1950699105,3cyclictest0-21swapper/208:31:452
1950699102,5cyclictest0-21swapper/208:06:592
1950499107,2cyclictest0-21swapper/007:33:300
1950499105,3cyclictest13286-21cron09:09:590
1950499103,5cyclictest0-21swapper/008:08:180
1950499102,7cyclictest0-21swapper/008:14:020
1950499102,7cyclictest0-21swapper/008:01:590
1950499102,6cyclictest0-21swapper/009:03:350
1950499102,6cyclictest0-21swapper/008:48:320
1950499102,6cyclictest0-21swapper/008:43:300
1950499102,6cyclictest0-21swapper/007:38:020
1950499102,6cyclictest0-21swapper/007:17:570
1950499102,5cyclictest0-21swapper/008:30:020
1950499100,7cyclictest0-21swapper/007:59:590
195079996,2cyclictest0-21swapper/307:54:313
195079994,3cyclictest8392-21unixbench_multi08:40:253
195079994,3cyclictest6283-21latency_hist08:35:003
195079994,3cyclictest30424-21processes07:55:173
195079994,3cyclictest25365-21cron07:35:003
195079992,4cyclictest0-21swapper/308:52:593
195079990,8cyclictest0-21swapper/309:07:543
195069994,3cyclictest4324-21nscd07:20:002
195069992,6cyclictest0-21swapper/207:33:012
195069991,6cyclictest0-21swapper/208:25:222
195069991,6cyclictest0-21swapper/208:10:232
195049996,2cyclictest0-21swapper/008:38:590
195049992,6cyclictest0-21swapper/007:53:050
195079983,3cyclictest22433-21taskset07:21:173
195079983,3cyclictest217242sleep307:15:113
195079980,7cyclictest0-21swapper/308:02:293
195069983,3cyclictest5129-21runrttasks07:47:202
195069980,2cyclictest0-21swapper/207:51:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional