You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-19 - 22:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sun Oct 19, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1858212096,19sleep00-21swapper/007:06:200
1953211797,15sleep20-21swapper/207:07:352
32597211693,15sleep10-21swapper/107:05:011
349211596,14sleep30-21swapper/307:05:113
244832770,1sleep30-21swapper/312:36:293
50552760,5sleep2217799cyclictest12:16:122
228982730,0sleep20-21swapper/210:54:552
69782640,1sleep30-21swapper/311:10:273
225642640,0sleep30-21swapper/311:27:153
217799357,11cyclictest0-21swapper/208:15:132
94862280,1sleep00-21swapper/007:25:170
249382260,0sleep30-21swapper/309:49:583
206082250,0sleep30-21swapper/311:59:453
217799230,18cyclictest0-21swapper/210:07:042
2177992219,2cyclictest3241-21kworker/u8:011:14:012
2177992219,2cyclictest2266-21kworker/u8:209:54:042
2177992219,2cyclictest12752-21kworker/u8:010:49:042
217799220,17cyclictest0-21swapper/211:24:042
217799220,17cyclictest0-21swapper/209:38:052
217799220,17cyclictest0-21swapper/207:47:052
2177992118,2cyclictest7863-21kworker/u8:210:40:052
2177992118,2cyclictest32507-21kworker/u8:108:22:052
2177992118,2cyclictest2266-21kworker/u8:209:27:042
2177992118,2cyclictest15151-21kworker/u8:011:30:052
2177992118,2cyclictest15151-21kworker/u8:011:25:052
2177992118,2cyclictest14628-21kworker/u8:109:32:062
2177992118,2cyclictest10754-21kworker/u8:007:34:052
217799211,3cyclictest0-21swapper/207:35:132
217799210,17cyclictest0-21swapper/212:36:042
217599211,2cyclictest0-21swapper/011:15:160
217599210,19cyclictest0-21swapper/011:55:120
2177992017,2cyclictest9821-21kworker/u8:111:15:052
2177992017,2cyclictest4725-21kworker/u8:009:00:022
2177992017,2cyclictest30472-21kworker/u8:211:06:052
2177992017,2cyclictest25740-21kworker/u8:112:10:012
217799201,2cyclictest0-21swapper/208:45:052
2175992017,2cyclictest0-21swapper/009:15:130
2175992015,3cyclictest5356-21ssh11:10:120
217599200,2cyclictest0-21swapper/008:45:120
2177991916,2cyclictest21865-21kworker/u8:010:25:052
2177991916,2cyclictest18419-21kworker/u8:108:06:052
2177991916,2cyclictest18419-21kworker/u8:107:55:052
2177991916,2cyclictest18419-21kworker/u8:107:52:012
2177991916,2cyclictest15151-21kworker/u8:011:46:042
2177991916,2cyclictest10754-21kworker/u8:007:42:022
217799190,14cyclictest0-21swapper/208:42:052
2177991815,2cyclictest32507-21kworker/u8:108:29:042
2177991815,2cyclictest32168-21kworker/u8:109:59:052
2177991815,2cyclictest32168-21kworker/u8:109:59:052
2177991815,2cyclictest27989-21kworker/u8:111:41:052
2177991815,2cyclictest26843-21kworker/u8:207:21:052
2177991815,2cyclictest2429-21kworker/u8:107:19:052
2177991815,2cyclictest2266-21kworker/u8:209:48:062
2177991815,2cyclictest18953-21kworker/u8:209:18:042
2177991815,2cyclictest16434-21kworker/u8:212:09:052
2177991815,2cyclictest16434-21kworker/u8:211:56:052
2177991815,2cyclictest14329-21kworker/u8:208:00:042
217799180,2cyclictest0-21swapper/212:20:052
217799180,2cyclictest0-21swapper/210:59:042
217899172,9cyclictest21826-21copy07:55:223
2177991714,2cyclictest30848-21kworker/u8:007:10:042
2177991714,2cyclictest16580-21kworker/u8:310:32:042
2177991714,2cyclictest15151-21kworker/u8:011:35:042
217799171,3cyclictest0-21swapper/209:40:142
217799170,2cyclictest0-21swapper/209:13:052
217699171,3cyclictest2971-21hddtemp_smartct07:10:191
217699171,14cyclictest14118-21users07:35:291
217599171,2cyclictest0-21swapper/008:15:130
160572170,0sleep10-21swapper/111:20:181
217899161,13cyclictest32168-21kworker/u8:110:11:203
217899161,13cyclictest0-21swapper/309:29:033
217899160,14cyclictest7600-21ps07:20:213
2177991613,2cyclictest10650-21kworker/u8:208:50:042
217799161,2cyclictest22426-21ssh10:20:172
217799160,2cyclictest0-21swapper/212:29:042
217799160,15cyclictest0-21swapper/210:13:052
217699161,3cyclictest21938-21munin-run12:35:011
217699161,13cyclictest0-21swapper/110:13:281
105172160,0sleep00-21swapper/012:22:040
217899152,7cyclictest0-21swapper/308:35:003
217899151,3cyclictest0-21swapper/308:14:003
2178991510,3cyclictest26917-21ssh09:50:333
2178991510,3cyclictest23403-21ssh12:01:373
217899150,13cyclictest4324-21nscd10:53:303
217899150,13cyclictest32484-21ssh11:04:513
217899150,13cyclictest0-21swapper/310:09:443
217799150,2cyclictest0-21swapper/210:38:052
217799150,2cyclictest0-21swapper/208:38:052
217799150,2cyclictest0-21swapper/208:14:052
217699151,12cyclictest24805-21munin-run08:04:591
217699151,12cyclictest21817-21apt-get07:55:251
2176991510,3cyclictest0-21swapper/110:55:071
2176991510,3cyclictest0-21swapper/109:24:431
217699150,13cyclictest0-21swapper/110:50:491
217599151,3cyclictest2886-21ssh10:00:150
217599151,3cyclictest2886-21ssh10:00:140
217599151,12cyclictest4926-21munin-node0
217599150,3cyclictest0-21swapper/009:51:280
217599150,13cyclictest0-21swapper/012:02:290
217599150,13cyclictest0-21swapper/010:48:190
2178991411,2cyclictest18742-21diskmemload12:08:103
2178991410,3cyclictest0-21swapper/309:37:173
2178991410,2cyclictest0-21swapper/311:34:593
2178991410,2cyclictest0-21swapper/310:02:413
2178991410,2cyclictest0-21swapper/310:02:403
2178991410,2cyclictest0-21swapper/307:45:053
217899140,2cyclictest0-21swapper/311:22:393
217899140,2cyclictest0-21swapper/311:15:103
217899140,2cyclictest0-21swapper/309:57:303
217899140,2cyclictest0-21swapper/309:57:303
217899140,13cyclictest0-21swapper/309:44:593
217899140,13cyclictest0-21swapper/307:40:213
217899140,12cyclictest32437-21ssh12:10:493
217899140,12cyclictest18742-21diskmemload09:11:083
217899140,12cyclictest14873-21ssh11:53:133
217899140,12cyclictest0-21swapper/310:36:223
2177991411,2cyclictest4725-21kworker/u8:008:55:052
217799140,12cyclictest0-21swapper/208:30:132
217699149,3cyclictest23793-21rm11:29:111
217699149,3cyclictest0-21swapper/109:59:571
217699149,3cyclictest0-21swapper/109:59:561
217699143,9cyclictest4874-21sshd10:35:201
217699141,2cyclictest1037-21apt-get09:25:151
2176991411,2cyclictest0-21swapper/110:32:081
217699140,3cyclictest7622-21cut08:40:151
217699140,3cyclictest0-21swapper/112:26:041
217699140,2cyclictest0-21swapper/112:14:571
217699140,2cyclictest0-21swapper/110:03:361
217699140,2cyclictest0-21swapper/110:03:351
217699140,2cyclictest0-21swapper/109:52:001
217699140,13cyclictest0-21swapper/112:22:481
217699140,13cyclictest0-21swapper/111:34:301
217699140,12cyclictest22279-21ssh09:13:091
217699140,12cyclictest18742-21diskmemload11:35:271
217699140,12cyclictest0-21swapper/110:26:231
217599149,3cyclictest3252-21taskset09:26:310
217599149,3cyclictest0-21swapper/010:30:140
217599141,2cyclictest1422-21apt-get11:40:070
2175991411,2cyclictest0-21swapper/012:15:380
2175991411,2cyclictest0-21swapper/011:46:500
2175991411,2cyclictest0-21swapper/011:21:500
217599141,11cyclictest401-21ssh09:57:220
217599141,11cyclictest401-21ssh09:57:210
217599141,11cyclictest0-21swapper/012:14:440
2175991410,2cyclictest0-21swapper/009:47:550
217599140,3cyclictest0-21swapper/012:30:140
217599140,2cyclictest0-21swapper/011:08:400
217599140,2cyclictest0-21swapper/011:01:290
217599140,13cyclictest18742-21diskmemload11:34:300
217599140,12cyclictest18742-21diskmemload10:35:090
217599140,12cyclictest0-21swapper/009:20:190
217599140,12cyclictest0-21swapper/008:05:140
217899139,2cyclictest10866-21ssh10:41:103
2178991310,2cyclictest0-21swapper/312:30:013
2178991310,2cyclictest0-21swapper/312:18:203
2178991310,2cyclictest0-21swapper/311:49:593
2178991310,2cyclictest0-21swapper/311:37:403
2178991310,2cyclictest0-21swapper/310:32:133
2178991310,2cyclictest0-21swapper/308:15:143
2178991310,2cyclictest0-21swapper/308:00:123
217899130,2cyclictest8104-21aten2.4_r3power12:20:123
217899130,2cyclictest0-21swapper/312:27:043
217899130,2cyclictest0-21swapper/311:05:223
217899130,2cyclictest0-21swapper/310:56:163
217899130,2cyclictest0-21swapper/309:18:093
217899130,12cyclictest0-21swapper/308:55:143
2177991310,2cyclictest18742-21diskmemload11:00:172
217799130,2cyclictest18742-21diskmemload12:30:292
217799130,2cyclictest0-21swapper/209:05:052
217799130,10cyclictest0-21swapper/212:02:572
217699138,3cyclictest0-21swapper/111:01:171
217699132,6cyclictest0-21swapper/111:05:001
2176991311,1cyclictest0-21swapper/111:55:381
2176991310,2cyclictest18742-21diskmemload12:07:471
2176991310,2cyclictest18742-21diskmemload10:05:391
2176991310,2cyclictest0-21swapper/111:50:081
2176991310,2cyclictest0-21swapper/109:40:021
2176991310,2cyclictest0-21swapper/108:20:141
2176991310,2cyclictest0-21swapper/107:25:281
2176991310,2cyclictest0-21swapper/107:20:191
217699130,3cyclictest0-21swapper/111:40:241
217699130,2cyclictest0-21swapper/112:16:241
217699130,2cyclictest0-21swapper/112:03:271
217699130,2cyclictest0-21swapper/111:46:571
217699130,2cyclictest0-21swapper/111:13:271
217699130,2cyclictest0-21swapper/110:15:121
217699130,2cyclictest0-21swapper/109:31:051
217699130,2cyclictest0-21swapper/108:30:151
217699130,12cyclictest0-21swapper/112:36:571
217699130,12cyclictest0-21swapper/111:17:081
217699130,12cyclictest0-21swapper/110:24:171
217699130,12cyclictest0-21swapper/108:25:261
217599138,3cyclictest0-21swapper/010:56:420
217599132,7cyclictest12469-21apt-get07:35:000
2175991310,2cyclictest0-21swapper/010:25:190
2175991310,2cyclictest0-21swapper/010:12:290
217599130,2cyclictest18742-21diskmemload12:05:160
217599130,2cyclictest0-21swapper/011:35:330
217599130,2cyclictest0-21swapper/009:31:490
217599130,12cyclictest0-21swapper/011:50:090
217599130,12cyclictest0-21swapper/010:06:300
217899129,2cyclictest0-21swapper/310:45:033
217899129,2cyclictest0-21swapper/310:27:333
217899129,2cyclictest0-21swapper/309:31:013
217899129,2cyclictest0-21swapper/309:20:023
217899129,2cyclictest0-21swapper/309:00:193
217899129,2cyclictest0-21swapper/307:25:263
217899129,2cyclictest0-21swapper/307:10:143
217899122,7cyclictest0-21swapper/307:34:593
217899120,2cyclictest0-21swapper/310:21:423
217899120,2cyclictest0-21swapper/308:35:263
217899120,11cyclictest0-21swapper/311:40:053
217899120,11cyclictest0-21swapper/310:15:283
217899120,11cyclictest0-21swapper/308:40:243
217799120,11cyclictest0-21swapper/211:52:352
217799120,10cyclictest30260-21ssh09:20:312
217699129,2cyclictest0-21swapper/109:16:071
217699121,9cyclictest5129-21runrttasks08:05:131
217699121,9cyclictest0-21swapper/108:45:051
217699120,2cyclictest0-21swapper/110:40:071
217699120,2cyclictest0-21swapper/109:45:371
217699120,2cyclictest0-21swapper/108:35:151
217699120,2cyclictest0-21swapper/107:30:201
217699120,11cyclictest0-21swapper/110:45:181
217699120,11cyclictest0-21swapper/109:35:081
217699120,11cyclictest0-21swapper/109:05:001
217699120,11cyclictest0-21swapper/108:55:231
217699120,11cyclictest0-21swapper/108:15:211
217699120,11cyclictest0-21swapper/107:50:121
217699120,11cyclictest0-21swapper/107:15:121
217599129,2cyclictest0-21swapper/012:35:020
217599129,2cyclictest0-21swapper/011:24:590
217599129,2cyclictest0-21swapper/008:40:110
217599129,2cyclictest0-21swapper/008:25:180
217599129,2cyclictest0-21swapper/007:55:110
217599129,2cyclictest0-21swapper/007:45:260
217599122,6cyclictest0-21swapper/010:50:240
217599122,6cyclictest0-21swapper/008:15:000
217599120,2cyclictest0-21swapper/010:43:150
217599120,2cyclictest0-21swapper/010:15:580
217599120,11cyclictest0-21swapper/012:26:050
217599120,11cyclictest0-21swapper/010:20:160
217599120,11cyclictest0-21swapper/009:40:150
217599120,11cyclictest0-21swapper/009:37:330
217599120,11cyclictest0-21swapper/009:12:090
217599120,11cyclictest0-21swapper/008:50:240
217899112,6cyclictest0-21swapper/309:06:593
217899110,1cyclictest0-21swapper/308:20:223
217899110,10cyclictest0-21swapper/307:35:173
217799118,2cyclictest0-21swapper/210:16:462
217799118,2cyclictest0-21swapper/207:25:122
217799110,10cyclictest0-21swapper/210:01:302
217799110,10cyclictest0-21swapper/210:01:292
217699112,5cyclictest0-21swapper/107:50:001
217699111,3cyclictest14940-21munin-node1
217599116,3cyclictest3537-21wc07:10:290
217599116,3cyclictest24812-21grep08:05:000
217599111,8cyclictest19074-21tr07:50:130
217599111,7cyclictest0-21swapper/007:23:590
217599111,3cyclictest16519-21cron07:44:590
217899103,2cyclictest0-21swapper/307:50:053
217899100,5cyclictest8643-21apt-get08:45:053
217699100,8cyclictest27356-21sed08:10:151
217699100,3cyclictest10898-21munin-node1
217599107,2cyclictest0-21swapper/008:30:160
217599105,3cyclictest13005-21telnet08:55:120
217599102,5cyclictest0-21swapper/007:15:580
21789994,3cyclictest26147-21switchtime08:05:263
21789994,3cyclictest1424-21missed_timers08:25:173
21789992,2cyclictest0-21swapper/308:50:043
21789991,6cyclictest0-21swapper/307:15:113
21769990,2cyclictest0-21swapper/107:40:141
21759994,3cyclictest13075-21df_abs07:35:160
21759993,3cyclictest17109-21aten2.4_r3power09:05:140
21759991,6cyclictest0-21swapper/008:21:330
21759991,3cyclictest0-21swapper/009:00:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional