You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 23:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Wed Dec 24, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18568212297,19sleep10-21swapper/107:08:371
18580211897,16sleep30-21swapper/307:08:463
18547211895,17sleep00-21swapper/007:08:200
18517211496,12sleep20-21swapper/207:07:582
9052750,1sleep2301ktimersoftd/211:40:252
141822730,0sleep00-21swapper/011:18:220
141822730,0sleep00-21swapper/011:18:210
135272700,0sleep20-21swapper/212:34:562
208672680,0sleep10-21swapper/108:34:381
33662200,0sleep00-21swapper/009:49:020
18707991916,2cyclictest3757-21kworker/u8:110:57:043
1870599182,2cyclictest0-21swapper/110:20:121
1870799170,15cyclictest0-21swapper/310:50:143
1870599170,15cyclictest0-21swapper/109:39:431
18707991613,2cyclictest3757-21kworker/u8:110:35:053
18707991613,2cyclictest31905-21kworker/u8:010:44:043
18707991613,2cyclictest1398-21kworker/u8:111:19:053
18707991613,2cyclictest1398-21kworker/u8:111:19:043
1870799160,14cyclictest2531-21ssh11:43:143
1870699161,13cyclictest0-21swapper/211:55:172
1870699161,13cyclictest0-21swapper/210:15:252
1870599161,3cyclictest0-21swapper/107:39:591
18705991613,2cyclictest6421-21kworker/u8:112:28:041
1870599160,2cyclictest0-21swapper/111:09:331
1870599160,2cyclictest0-21swapper/111:09:321
1870599160,14cyclictest0-21swapper/112:20:041
1870599160,14cyclictest0-21swapper/111:58:041
1870599160,14cyclictest0-21swapper/111:53:341
1870799151,3cyclictest17872-21memory08:25:173
18707991512,2cyclictest28316-21kworker/u8:212:15:043
18707991512,2cyclictest0-21swapper/311:04:343
1870799150,2cyclictest0-21swapper/309:57:123
1870799150,13cyclictest2569-21diskmemload09:45:033
1870799150,13cyclictest16087-21df_abs09:25:143
1870799150,13cyclictest0-21swapper/310:25:233
1870799150,13cyclictest0-21swapper/310:18:533
1870699151,3cyclictest29979-21memory08:55:192
1870699151,12cyclictest2569-21diskmemload10:14:362
1870699151,12cyclictest0-21swapper/210:32:332
1870699150,3cyclictest2569-21diskmemload10:35:192
1870599151,3cyclictest3712-21ntp_states07:50:171
1870599151,3cyclictest2569-21diskmemload12:30:391
1870599151,3cyclictest24716-21munin-run12:10:001
18705991512,2cyclictest2569-21diskmemload11:28:341
18705991512,2cyclictest2569-21diskmemload10:58:221
1870599151,12cyclictest0-21swapper/110:54:071
1870599150,2cyclictest2569-21diskmemload10:13:321
1870599150,14cyclictest2569-21diskmemload09:57:121
1870599150,13cyclictest32474-21grep07:40:251
1870599150,13cyclictest2569-21diskmemload11:44:141
1870599150,13cyclictest2569-21diskmemload11:35:011
1870599150,13cyclictest0-21swapper/110:00:111
1870599150,13cyclictest0-21swapper/109:50:211
1870599150,13cyclictest0-21swapper/109:27:001
1870499150,13cyclictest2569-21diskmemload11:21:580
1870499150,13cyclictest0-21swapper/012:05:160
1870499150,13cyclictest0-21swapper/010:48:570
1870499150,13cyclictest0-21swapper/009:40:170
93182141,3sleep39328-21ssh10:34:363
18707991411,2cyclictest31905-21kworker/u8:011:07:043
18707991411,2cyclictest31905-21kworker/u8:011:07:033
18707991411,2cyclictest22754-21kworker/u8:209:33:043
18707991411,2cyclictest0-21swapper/312:10:143
18707991411,2cyclictest0-21swapper/311:55:133
18707991411,2cyclictest0-21swapper/311:25:073
1870799140,2cyclictest0-21swapper/311:30:533
1870799140,12cyclictest8223-21threads11:10:263
1870799140,12cyclictest26937-21ssh09:37:383
1870799140,12cyclictest2569-21diskmemload12:38:133
1870799140,12cyclictest2569-21diskmemload09:52:433
1870799140,12cyclictest0-21swapper/312:00:213
1870799140,12cyclictest0-21swapper/311:35:143
1870799140,12cyclictest0-21swapper/311:22:323
1870799140,12cyclictest0-21swapper/309:41:193
1870799140,12cyclictest0-21swapper/307:55:163
1870699141,3cyclictest10517-21ssh11:51:572
18706991411,2cyclictest2569-21diskmemload11:49:312
18706991411,2cyclictest0-21swapper/209:10:512
1870699141,11cyclictest0-21swapper/209:32:392
1870699140,3cyclictest6431-21nscd09:26:252
1870699140,2cyclictest0-21swapper/209:54:322
1870699140,13cyclictest0-21swapper/211:37:212
1870699140,13cyclictest0-21swapper/210:42:222
1870699140,12cyclictest2569-21diskmemload12:21:262
1870699140,12cyclictest2569-21diskmemload11:20:032
1870699140,12cyclictest0-21swapper/209:49:152
18705991411,2cyclictest2569-21diskmemload11:19:331
18705991411,2cyclictest2569-21diskmemload11:19:321
18705991411,2cyclictest2569-21diskmemload11:02:271
18705991411,2cyclictest0-21swapper/112:14:061
18705991411,2cyclictest0-21swapper/111:45:071
18705991411,2cyclictest0-21swapper/111:24:131
18705991411,2cyclictest0-21swapper/109:18:231
18705991411,2cyclictest0-21swapper/107:45:141
18705991411,2cyclictest0-21swapper/107:25:131
1870599140,3cyclictest0-21swapper/109:41:101
1870599140,2cyclictest0-21swapper/111:30:041
1870599140,2cyclictest0-21swapper/110:28:121
1870599140,2cyclictest0-21swapper/109:32:101
1870599140,13cyclictest0-21swapper/111:13:491
1870599140,13cyclictest0-21swapper/110:47:051
1870599140,13cyclictest0-21swapper/109:10:421
1870599140,12cyclictest2569-21diskmemload12:35:331
1870599140,12cyclictest0-21swapper/108:20:161
18704991411,2cyclictest2569-21diskmemload10:39:070
1870499140,2cyclictest0-21swapper/012:13:370
1870499140,2cyclictest0-21swapper/011:49:090
1870499140,2cyclictest0-21swapper/010:50:060
1870499140,13cyclictest0-21swapper/012:38:460
1870499140,12cyclictest7039-21sed10:30:280
1870499140,12cyclictest2569-21diskmemload10:41:210
1870499140,12cyclictest2569-21diskmemload09:53:350
1870499140,12cyclictest2569-21diskmemload09:20:540
1870499140,12cyclictest0-21swapper/011:30:450
1870499140,12cyclictest0-21swapper/011:25:130
1870499140,12cyclictest0-21swapper/011:05:270
1870499140,12cyclictest0-21swapper/011:05:260
1870499140,12cyclictest0-21swapper/010:59:350
1870499140,12cyclictest0-21swapper/010:01:300
1870499140,12cyclictest0-21swapper/009:55:370
1870499140,12cyclictest0-21swapper/009:18:050
1870799139,2cyclictest0-21swapper/309:00:233
1870799139,2cyclictest0-21swapper/309:00:233
1870799131,11cyclictest18703-21cyclictest09:21:433
18707991310,2cyclictest2569-21diskmemload10:06:213
18707991310,2cyclictest0-21swapper/312:31:573
18707991310,2cyclictest0-21swapper/312:20:333
1870799130,2cyclictest0-21swapper/312:07:083
1870799130,2cyclictest0-21swapper/310:22:303
1870799130,2cyclictest0-21swapper/309:10:043
1870799130,12cyclictest0-21swapper/310:45:093
1870799130,12cyclictest0-21swapper/310:10:153
1870799130,12cyclictest0-21swapper/309:17:143
18706991310,2cyclictest31611-21ssh10:21:222
18706991310,2cyclictest24441-21ssh09:35:172
18706991310,2cyclictest21428-21ssh10:48:292
18706991310,2cyclictest0-21swapper/211:29:262
18706991310,2cyclictest0-21swapper/211:00:252
1870699130,3cyclictest4901-21sh11:06:482
1870699130,3cyclictest4901-21sh11:06:472
1870699130,2cyclictest0-21swapper/212:00:342
1870699130,2cyclictest0-21swapper/211:15:362
1870699130,2cyclictest0-21swapper/211:15:352
1870699130,2cyclictest0-21swapper/211:11:562
1870699130,2cyclictest0-21swapper/210:00:302
1870699130,2cyclictest0-21swapper/209:41:102
1870699130,12cyclictest1967-21ssh10:25:162
1870699130,12cyclictest0-21swapper/212:15:572
1870699130,12cyclictest0-21swapper/212:10:262
1870699130,12cyclictest0-21swapper/210:05:082
1870699130,12cyclictest0-21swapper/209:55:152
1870699130,12cyclictest0-21swapper/209:20:182
1870699130,12cyclictest0-21swapper/209:19:342
1870699130,11cyclictest29142-21kworker/u8:210:57:102
1870599131,10cyclictest12555-21cut09:20:201
18705991310,2cyclictest0-21swapper/112:15:141
18705991310,2cyclictest0-21swapper/112:04:221
18705991310,2cyclictest0-21swapper/110:42:271
18705991310,2cyclictest0-21swapper/110:31:301
18705991310,2cyclictest0-21swapper/110:05:011
18705991310,2cyclictest0-21swapper/109:00:171
18705991310,2cyclictest0-21swapper/109:00:161
1870599130,2cyclictest0-21swapper/109:46:581
1870599130,2cyclictest0-21swapper/107:10:111
1870599130,12cyclictest0-21swapper/110:35:231
1870599130,12cyclictest0-21swapper/110:16:531
1870599130,12cyclictest0-21swapper/108:00:141
18704991310,2cyclictest2569-21diskmemload11:37:090
18704991310,2cyclictest16656-21apt-get10:05:060
18704991310,2cyclictest0-21swapper/012:30:580
18704991310,2cyclictest0-21swapper/012:21:360
18704991310,2cyclictest0-21swapper/011:57:140
18704991310,2cyclictest0-21swapper/011:53:340
18704991310,2cyclictest0-21swapper/011:10:360
18704991310,2cyclictest0-21swapper/010:28:450
18704991310,2cyclictest0-21swapper/010:10:560
18704991310,2cyclictest0-21swapper/009:30:470
18704991310,2cyclictest0-21swapper/009:00:200
18704991310,2cyclictest0-21swapper/009:00:190
1870499130,2cyclictest26080-21python07:25:240
1870499130,2cyclictest2569-21diskmemload10:21:400
1870499130,2cyclictest2569-21diskmemload09:36:400
1870499130,2cyclictest2569-21diskmemload09:13:280
1870499130,2cyclictest0-21swapper/012:01:570
1870499130,2cyclictest0-21swapper/009:25:180
1870499130,2cyclictest0-21swapper/007:30:140
1870499130,12cyclictest0-21swapper/012:25:000
1870499130,12cyclictest0-21swapper/011:40:110
1870499130,12cyclictest0-21swapper/011:03:250
1870799120,2cyclictest0-21swapper/312:25:193
1870799120,11cyclictest0-21swapper/311:52:153
1870799120,11cyclictest0-21swapper/311:47:553
1870799120,11cyclictest0-21swapper/307:30:243
1870799120,11cyclictest0-21swapper/307:10:143
1870699129,2cyclictest2569-21diskmemload12:29:492
1870699129,2cyclictest0-21swapper/212:36:212
1870699129,2cyclictest0-21swapper/210:54:592
1870699120,11cyclictest0-21swapper/212:05:142
1870699120,11cyclictest0-21swapper/211:31:012
1870699120,11cyclictest0-21swapper/208:10:152
1870699120,11cyclictest0-21swapper/208:05:162
1870699120,11cyclictest0-21swapper/207:30:172
1870699120,11cyclictest0-21swapper/207:25:192
1870599129,2cyclictest21280-21kworker/u8:008:43:051
1870599129,2cyclictest0-21swapper/107:20:141
1870599127,3cyclictest5384-21tune2fs07:55:151
1870599121,9cyclictest0-21swapper/107:15:181
1870599121,4cyclictest2662-21wc09:10:001
1870599120,11cyclictest0-21swapper/108:15:211
1870599120,10cyclictest0-21swapper/108:55:241
1870499129,2cyclictest18968-21basename07:10:100
1870499120,2cyclictest31594-21ssh12:16:490
1870499120,11cyclictest0-21swapper/010:15:180
1870499120,11cyclictest0-21swapper/008:25:180
1870799118,2cyclictest21523-21hwlatdetect07:15:163
1870799118,2cyclictest0-21swapper/307:45:113
1870799118,2cyclictest0-21swapper/307:35:173
1870799110,10cyclictest0-21swapper/310:02:373
1870699110,1cyclictest0-21swapper/208:45:182
1870699110,1cyclictest0-21swapper/208:35:172
1870599111,9cyclictest27191-21munin-node1
1870599111,3cyclictest11050-21munin-node1
1870599110,9cyclictest0-21swapper/108:05:151
1870599110,10cyclictest0-21swapper/108:45:261
1870499118,2cyclictest26098-21open_files08:45:180
1870499110,3cyclictest30226-21pzem_voltage08:55:240
168382110,2sleep30-21swapper/308:24:353
1870799107,2cyclictest2331-21kworker/u8:007:53:053
1870799106,2cyclictest0-21swapper/307:25:153
1870799106,2cyclictest0-21swapper/307:24:593
1870699107,2cyclictest0-21swapper/208:40:192
1870699105,3cyclictest8082-21find08:00:232
1870699105,3cyclictest1821-21find09:05:212
1870699105,3cyclictest14846-21cron08:20:002
1870599107,2cyclictest0-21swapper/108:35:101
1870599107,2cyclictest0-21swapper/107:30:131
1870599100,2cyclictest0-21swapper/108:25:141
1870499107,2cyclictest22914-21apt-get08:40:070
1870499107,2cyclictest0-21swapper/008:35:160
1870499107,2cyclictest0-21swapper/008:32:190
1870499107,2cyclictest0-21swapper/008:15:190
1870499107,2cyclictest0-21swapper/007:45:240
1870499107,2cyclictest0-21swapper/007:15:180
1870499100,9cyclictest0-21swapper/007:44:250
24877290,2sleep30-21swapper/308:43:593
187079996,2cyclictest386-21kworker/u8:009:05:043
187079996,2cyclictest26416-21kworker/u8:207:42:053
187079996,2cyclictest25181-21kworker/u8:208:47:033
187079996,2cyclictest21280-21kworker/u8:008:38:053
187079996,2cyclictest0-21swapper/308:55:183
187079994,3cyclictest6859-21nscd08:15:183
187079990,7cyclictest7248-21tr08:00:133
187069994,3cyclictest7458-21runrttasks08:50:122
187069994,3cyclictest7458-21runrttasks07:15:332
187069994,3cyclictest4929-21aten2.4_r3power07:55:122
187069994,3cyclictest31964-21ntpq07:40:182
187069994,3cyclictest30831-21cron07:40:002
187069994,3cyclictest20515-21head08:30:522
187069994,3cyclictest20286-21unixbench_singl07:10:252
187069994,3cyclictest17095-21munin-node2
187069993,4cyclictest15665-21hddtemp_smartct08:20:142
187069991,3cyclictest3930-21python07:50:232
187069991,3cyclictest0-21swapper/207:20:202
187049996,2cyclictest0-21swapper/008:10:270
187049994,3cyclictest6013-21wc07:55:270
187049994,3cyclictest15503-21sort08:20:140
187079985,2cyclictest25181-21kworker/u8:208:50:053
187079985,2cyclictest0-21swapper/308:10:193
187079984,2cyclictest10963-21latency_hist08:10:013
187079980,7cyclictest0-21swapper/308:30:373
187069983,3cyclictest936-21sed07:45:132
187069983,3cyclictest31326-21telnet09:00:142
187069983,3cyclictest31326-21telnet09:00:132
187049985,2cyclictest797-21aten2.4_r3power09:05:110
187049985,2cyclictest0-21swapper/007:53:210
187049985,2cyclictest0-21swapper/007:35:060
187049984,2cyclictest24350-21unixbench_singl07:20:300
187049983,3cyclictest9931-21ntpq08:05:180
187049983,3cyclictest7458-21runrttasks08:00:100
187049983,3cyclictest27774-21smartctl08:50:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional