You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 16:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Apr 24, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
410023522700,6sleep00-21swapper/007:05:210
409999522420,6sleep1251rcuc/107:05:181
41761822970,2sleep20-21swapper/210:40:172
409959729743,44sleep30-21swapper/307:05:133
409995727444,21sleep20-21swapper/207:05:152
41211892610,3sleep0161rcuc/008:05:010
41329822530,3sleep10-21swapper/108:35:211
41017692440,4sleep30-21swapper/307:10:143
41123132330,1chrt4112316-21turbostat.cron07:39:592
4101176993026,3cyclictest1228-21cstates11:35:120
175252270,3chrt3056-21PK-Backend12:20:153
4101183992420,3cyclictest34-21ksoftirqd/209:58:422
410117899240,22cyclictest1895009-21snapd10:44:151
139099240,4rtkit-daemon1389-21rtkit-daemon10:48:531
139099240,3rtkit-daemon1389-21rtkit-daemon08:30:080
41599562230,3chrt0-21swapper/309:55:103
410118699238,13cyclictest21159-21latency12:30:153
410118399231,3cyclictest141rcu_preempt08:56:162
4101178992316,5cyclictest436-20systemd-journal11:45:241
410117899230,2cyclictest4123913-21strings08:10:171
410117899230,21cyclictest3056-21PK-Backend08:59:111
4101186992220,1cyclictest0-21swapper/308:45:253
4101186992219,2cyclictest3056-21PK-Backend11:58:513
4101186992219,2cyclictest3056-21PK-Backend10:50:513
4101186992216,4cyclictest4190473-21tr11:20:183
4101186992213,7cyclictest4173540-21cron10:35:003
410118699220,20cyclictest3056-21PK-Backend07:52:463
4101183992220,1cyclictest0-21swapper/209:20:542
4101183992211,4cyclictest34-21ksoftirqd/212:18:252
410117899222,18cyclictest4114058-21munin-run07:44:591
4101178992220,1cyclictest3056-21PK-Backend11:05:041
4101178992218,3cyclictest0-21swapper/108:25:111
410117899221,20cyclictest0-21swapper/109:35:201
4101176992220,1cyclictest0-21swapper/011:26:070
4101176992220,1cyclictest0-21swapper/008:08:290
4101176992220,1cyclictest0-21swapper/007:48:280
4101176992219,2cyclictest3056-21PK-Backend10:17:040
4101176992214,6cyclictest4177198-21umount10:44:430
139099220,4rtkit-daemon1389-21rtkit-daemon12:05:351
139099220,4rtkit-daemon1389-21rtkit-daemon10:32:400
4101186992119,1cyclictest3056-21PK-Backend10:47:323
4101186992119,1cyclictest3056-21PK-Backend09:20:063
4101186992119,1cyclictest3056-21PK-Backend08:10:313
4101186992119,1cyclictest3056-21PK-Backend08:03:333
4101186992119,1cyclictest0-21swapper/312:05:333
4101186992119,1cyclictest0-21swapper/311:10:243
4101186992119,1cyclictest0-21swapper/310:11:303
4101186992119,1cyclictest0-21swapper/310:11:293
4101186992119,1cyclictest0-21swapper/310:02:243
4101186992119,1cyclictest0-21swapper/308:54:523
4101186992119,1cyclictest0-21swapper/307:40:093
4101186992118,2cyclictest3056-21PK-Backend11:45:393
4101186992115,3cyclictest4194080-21python311:30:203
410118699210,20cyclictest3056-21PK-Backend12:17:093
410118699210,20cyclictest3056-21PK-Backend09:28:303
410118699210,20cyclictest0-21swapper/312:37:093
410118699210,20cyclictest0-21swapper/312:29:543
410118699210,19cyclictest3056-21PK-Backend08:33:553
4101183992119,1cyclictest0-21swapper/212:09:472
4101183992119,1cyclictest0-21swapper/210:36:252
4101183992119,1cyclictest0-21swapper/210:33:212
4101183992119,1cyclictest0-21swapper/210:27:252
4101183992119,1cyclictest0-21swapper/209:09:312
4101183992119,1cyclictest0-21swapper/208:51:142
4101183992119,1cyclictest0-21swapper/208:00:512
4101183992119,1cyclictest0-21swapper/207:45:162
4101183992117,3cyclictest4154067-21nm-dispatcher09:38:422
4101183992110,4cyclictest34-21ksoftirqd/212:13:492
4101183992110,4cyclictest34-21ksoftirqd/212:04:312
4101183992110,4cyclictest34-21ksoftirqd/210:21:442
410118399210,20cyclictest0-21swapper/211:25:042
4101178992119,1cyclictest3056-21PK-Backend12:29:261
4101178992119,1cyclictest3056-21PK-Backend11:12:281
4101178992119,1cyclictest0-21swapper/110:57:261
4101178992119,1cyclictest0-21swapper/110:31:171
4101178992119,1cyclictest0-21swapper/109:43:111
4101178992119,1cyclictest0-21swapper/109:21:081
4101178992113,6cyclictest4149918-21grep09:25:171
410117899210,19cyclictest3056-21PK-Backend10:01:231
410117899210,19cyclictest3056-21PK-Backend07:30:221
410117899210,19cyclictest0-21swapper/111:50:061
4101176992119,1cyclictest0-21swapper/009:00:270
410117699211,18cyclictest4129247-21ps08:25:190
410117699210,20cyclictest0-21swapper/010:58:080
410117699210,20cyclictest0-21swapper/010:54:030
410117699210,20cyclictest0-21swapper/008:39:180
410117699210,20cyclictest0-21swapper/008:12:070
410117699210,1cyclictest0-21swapper/008:53:430
410118699203,15cyclictest4143018-21netstat09:05:183
4101186992018,1cyclictest3056-21PK-Backend11:40:323
4101186992018,1cyclictest3056-21PK-Backend10:43:133
4101186992018,1cyclictest3056-21PK-Backend08:23:083
4101186992018,1cyclictest3056-21PK-Backend08:15:243
4101186992018,1cyclictest0-21swapper/307:36:173
4101186992017,2cyclictest3056-21PK-Backend07:46:043
4101186992012,6cyclictest4168606-21cat10:20:103
4101186992012,6cyclictest4108298-21cat07:25:203
410118699200,19cyclictest3056-21PK-Backend11:53:103
410118699200,19cyclictest3056-21PK-Backend10:35:373
410118699200,19cyclictest3056-21PK-Backend09:30:483
410118699200,19cyclictest3056-21PK-Backend08:26:593
410118699200,19cyclictest3056-21PK-Backend08:08:283
410118699200,19cyclictest0-21swapper/311:25:593
410118699200,19cyclictest0-21swapper/311:08:083
410118699200,19cyclictest0-21swapper/311:04:503
410118699200,19cyclictest0-21swapper/307:16:093
410118699200,18cyclictest3056-21PK-Backend12:01:423
410118399209,4cyclictest34-21ksoftirqd/211:55:242
410118399209,4cyclictest34-21ksoftirqd/211:54:392
410118399207,4cyclictest34-21ksoftirqd/207:30:132
410118399204,15cyclictest1095-21runrttasks11:23:492
4101183992018,1cyclictest0-21swapper/211:15:312
4101183992018,1cyclictest0-21swapper/207:52:332
4101183992018,1cyclictest0-21swapper/207:24:282
4101183992016,2cyclictest4164613-21apt-get10:10:022
4101183992016,2cyclictest4164613-21apt-get10:10:022
4101183992015,4cyclictest34-21ksoftirqd/211:10:012
4101183992013,5cyclictest4167080-21cat10:15:112
4101183992013,5cyclictest4158066-21tr09:50:122
410118399200,19cyclictest0-21swapper/211:32:492
410118399200,19cyclictest0-21swapper/208:42:272
410118399200,19cyclictest0-21swapper/208:12:332
410118399200,19cyclictest0-21swapper/208:05:162
410118399200,19cyclictest0-21swapper/207:58:002
410118399200,19cyclictest0-21swapper/207:12:522
4101178992018,1cyclictest3056-21PK-Backend10:12:321
4101178992018,1cyclictest3056-21PK-Backend10:12:311
4101178992018,1cyclictest3056-21PK-Backend09:51:161
4101178992018,1cyclictest3056-21PK-Backend07:18:521
4101178992018,1cyclictest0-21swapper/112:04:181
4101178992018,1cyclictest0-21swapper/111:44:111
4101178992018,1cyclictest0-21swapper/110:52:061
4101178992018,1cyclictest0-21swapper/110:21:241
4101178992018,1cyclictest0-21swapper/108:05:241
4101178992018,1cyclictest0-21swapper/107:49:281
410117899200,1cyclictest3056-21PK-Backend12:22:241
410117899200,1cyclictest3056-21PK-Backend09:56:501
410117899200,19cyclictest3056-21PK-Backend10:19:081
410117899200,19cyclictest0-21swapper/109:33:041
410117899200,19cyclictest0-21swapper/108:45:381
410117899200,19cyclictest0-21swapper/108:17:121
410117899200,19cyclictest0-21swapper/108:03:211
410117899200,19cyclictest0-21swapper/107:50:301
4101176992018,1cyclictest0-21swapper/012:05:060
4101176992018,1cyclictest0-21swapper/011:56:150
4101176992018,1cyclictest0-21swapper/011:51:490
4101176992018,1cyclictest0-21swapper/010:02:250
4101176992018,1cyclictest0-21swapper/009:46:290
4101176992015,3cyclictest4155539-21users09:40:210
410117699200,19cyclictest0-21swapper/012:28:460
410117699200,19cyclictest0-21swapper/012:14:320
410117699200,19cyclictest0-21swapper/010:20:570
410117699200,19cyclictest0-21swapper/009:24:460
410117699200,19cyclictest0-21swapper/007:58:200
139099200,16rtkit-daemon4101171-21cyclictest09:46:061
4101186991917,1cyclictest3056-21PK-Backend11:35:263
4101186991917,1cyclictest0-21swapper/309:51:013
4101186991912,5cyclictest4167773-21cat10:15:193
4101186991911,6cyclictest436-20systemd-journal09:45:013
410118699190,1cyclictest0-21swapper/307:23:533
410118699190,18cyclictest0-21swapper/307:30:353
410118399199,4cyclictest34-21ksoftirqd/208:35:302
410118399198,4cyclictest34-21ksoftirqd/211:37:082
410118399198,4cyclictest34-21ksoftirqd/209:16:532
410118399198,4cyclictest34-21ksoftirqd/208:18:592
410118399197,3cyclictest141rcu_preempt09:15:002
410118399197,2cyclictest141rcu_preempt07:15:142
4101183991917,1cyclictest0-21swapper/212:38:052
4101183991917,1cyclictest0-21swapper/211:14:312
4101183991915,3cyclictest34-21ksoftirqd/209:35:002
410118399190,1cyclictest0-21swapper/211:47:012
410118399190,1cyclictest0-21swapper/210:04:402
410118399190,18cyclictest0-21swapper/212:20:272
410118399190,18cyclictest0-21swapper/207:44:152
410118399190,17cyclictest1-21systemd11:45:012
4101178991917,1cyclictest3056-21PK-Backend12:37:311
4101178991917,1cyclictest3056-21PK-Backend11:15:321
4101178991917,1cyclictest3056-21PK-Backend07:12:031
4101178991917,1cyclictest0-21swapper/112:13:521
4101178991917,1cyclictest0-21swapper/111:35:591
4101178991911,6cyclictest883-21dbus-daemon08:35:011
410117899190,1cyclictest3056-21PK-Backend12:31:151
410117899190,1cyclictest3056-21PK-Backend07:36:511
410117899190,1cyclictest0-21swapper/110:35:361
410117899190,18cyclictest3056-21PK-Backend07:25:431
410117899190,18cyclictest0-21swapper/111:55:461
4101176991917,1cyclictest0-21swapper/012:03:180
4101176991917,1cyclictest0-21swapper/011:47:230
4101176991917,1cyclictest0-21swapper/011:13:220
4101176991917,1cyclictest0-21swapper/008:22:140
4101176991917,1cyclictest0-21swapper/007:25:350
4101176991911,6cyclictest4135760-21df08:45:140
410117699190,7cyclictest4184296-21awk11:05:000
410117699190,1cyclictest0-21swapper/012:19:000
410117699190,1cyclictest0-21swapper/011:06:530
410117699190,1cyclictest0-21swapper/009:28:510
410117699190,18cyclictest3056-21PK-Backend07:39:350
410117699190,18cyclictest0-21swapper/010:48:560
139099190,15rtkit-daemon4101171-21cyclictest09:38:310
4101186991816,1cyclictest3056-21PK-Backend09:37:233
4101186991816,1cyclictest3056-21PK-Backend07:58:403
4101186991816,1cyclictest0-21swapper/312:10:263
4101186991815,2cyclictest3056-21PK-Backend10:25:573
4101186991812,4cyclictest4189705-21date11:20:003
410118699180,16cyclictest4141449-21python309:00:193
410118399189,3cyclictest34-21ksoftirqd/208:28:052
410118399188,3cyclictest34-21ksoftirqd/210:59:302
410118399187,4cyclictest34-21ksoftirqd/209:26:562
4101183991816,1cyclictest0-21swapper/212:29:412
4101183991816,1cyclictest0-21swapper/211:03:422
4101183991814,3cyclictest1095-21runrttasks12:32:032
4101183991813,4cyclictest2156-21gnome-shell10:05:082
4101183991812,4cyclictest4156970-21pluginstate09:45:192
4101183991810,6cyclictest4107330-21apt07:25:112
4101178991816,1cyclictest0-21swapper/110:28:001
4101178991816,1cyclictest0-21swapper/110:05:551
4101178991816,1cyclictest0-21swapper/108:20:171
4101178991816,1cyclictest0-21swapper/107:57:261
4101178991810,6cyclictest4146952-21sshd09:16:231
4101178991810,6cyclictest4135130-21sh08:45:011
4101176991816,1cyclictest0-21swapper/009:14:260
4101176991816,1cyclictest0-21swapper/009:08:450
4101176991811,5cyclictest4174049-21ls10:35:130
4101176991810,6cyclictest4134060-21which08:40:160
4101176991810,6cyclictest4116239-21grep07:50:100
4101176991810,6cyclictest3011-21grep11:40:110
4101186991712,3cyclictest4156375-21grep09:45:123
4101186991711,4cyclictest4164002-21python310:05:203
410118399177,3cyclictest34-21ksoftirqd/208:46:182
4101183991715,1cyclictest0-21swapper/210:53:072
4101183991715,1cyclictest0-21swapper/209:41:292
4101183991715,1cyclictest0-21swapper/208:24:172
4101178991715,1cyclictest3056-21PK-Backend07:23:531
4101178991715,1cyclictest0-21swapper/111:20:391
4101178991712,3cyclictest4193863-21needreboot11:30:161
4101176991715,1cyclictest0-21swapper/012:39:200
4101176991712,4cyclictest4103746-21tr07:15:130
4101176991710,6cyclictest4125552-21sed08:15:170
4101176991710,5cyclictest4139629-21which08:55:170
410117699170,16cyclictest0-21swapper/007:44:490
410117699170,16cyclictest0-21swapper/007:21:230
41341082160,3chrt3056-21PK-Backend08:40:163
4101186991614,1cyclictest3056-21PK-Backend10:59:303
410118699160,14cyclictest4138913-21cat08:55:103
4101183991614,1cyclictest0-21swapper/209:00:592
4101183991612,3cyclictest4130356-21tr08:30:112
4101178991610,4cyclictest4183199-21cat11:00:131
4101176991614,1cyclictest3056-21PK-Backend11:33:230
4101176991614,1cyclictest3056-21PK-Backend09:50:350
4101176991614,1cyclictest0-21swapper/010:12:120
4101176991614,1cyclictest0-21swapper/010:12:110
4101176991614,1cyclictest0-21swapper/007:30:360
4101176991614,1cyclictest0-21swapper/007:11:440
4101176991610,5cyclictest4151628-21needreboot09:30:170
410117699160,1cyclictest3056-21PK-Backend11:20:390
410117699160,14cyclictest4164076-21threads10:05:200
139099160,13rtkit-daemon0-21swapper/112:16:241
4101186991513,1cyclictest3056-21PK-Backend09:16:013
410118399150,5cyclictest886-21NetworkManager10:46:372
4101178991513,1cyclictest3056-21PK-Backend11:25:451
4101178991512,2cyclictest3056-21PK-Backend08:53:031
410117699159,5cyclictest21411-21proc_pri12:30:180
410117699159,4cyclictest4188508-21sed11:15:160
410117699158,6cyclictest4171301-21cat10:25:200
4101176991511,3cyclictest13-21ksoftirqd/009:20:010
410117699151,11cyclictest17143-21apt12:20:120
4101186991411,2cyclictest3056-21PK-Backend08:38:243
4101186991410,3cyclictest3056-21PK-Backend09:14:413
410117899149,3cyclictest4144037-21acpi09:10:091
410117699149,4cyclictest4161221-21grep10:00:010
410117899138,3cyclictest1095-21runrttasks09:08:411
410117899137,5cyclictest26-21ksoftirqd/109:05:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional