You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 15:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Tue Apr 07, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
282079021110,3sleep00-21swapper/007:10:030
28203802940,4sleep32820379-21cpufreq07:10:023
281988827840,32sleep20-21swapper/207:05:392
139099740,59rtkit-daemon0-21swapper/007:07:440
281987526345,13sleep10-21swapper/107:05:301
28775362440,2sleep32877530-21gpgv09:50:013
139099420,4rtkit-daemon1389-21rtkit-daemon12:28:172
139099380,3rtkit-daemon3056-21PK-Backend07:45:241
28656862370,2sleep30-21swapper/309:15:123
28528872370,2sleep03056-21PK-Backend08:40:000
139099370,3rtkit-daemon0-21swapper/109:28:091
28533312310,2sleep30-21swapper/308:40:123
28324142280,4chrt3056-21PK-Backend07:40:133
139099280,4rtkit-daemon1389-21rtkit-daemon11:13:492
2820457992615,9cyclictest2878342-21smartctl09:50:142
282044999250,7cyclictest436-20systemd-journal10:30:000
282044999250,7cyclictest436-20systemd-journal10:30:000
2820449992415,7cyclictest2895015-21apt-get10:39:590
282046499233,8cyclictest883-21dbus-daemon11:05:003
2820464992321,1cyclictest0-21swapper/312:34:513
2820464992320,2cyclictest0-21swapper/310:18:033
2820456992315,6cyclictest436-20systemd-journal07:15:011
139099230,16rtkit-daemon3056-21PK-Backend09:16:301
139099230,15rtkit-daemon0-21swapper/009:12:100
28647672220,2sleep10-21swapper/109:10:211
28490692220,10sleep23056-21PK-Backend08:26:282
282046499226,14cyclictest2883811-21needreboot10:05:163
2820464992220,1cyclictest3056-21PK-Backend12:25:183
2820464992220,1cyclictest0-21swapper/311:07:103
2820464992220,1cyclictest0-21swapper/307:49:123
2820464992219,2cyclictest3056-21PK-Backend09:32:483
2820464992219,2cyclictest3056-21PK-Backend07:28:103
2820464992219,2cyclictest3056-21PK-Backend07:28:103
2820457992216,4cyclictest34-21ksoftirqd/211:25:012
2820457992214,6cyclictest883-21dbus-daemon12:11:422
282045799220,5cyclictest2920339-21munin-plugin-st11:50:002
2820456992220,1cyclictest0-21swapper/111:49:501
2820456992217,3cyclictest2823414-21df07:15:131
28624492210,4chrt0-21swapper/109:05:121
2820464992119,1cyclictest3056-21PK-Backend11:27:043
2820464992119,1cyclictest3056-21PK-Backend10:52:583
2820464992119,1cyclictest3056-21PK-Backend09:27:343
2820464992119,1cyclictest3056-21PK-Backend09:24:573
2820464992119,1cyclictest3056-21PK-Backend07:12:213
2820464992119,1cyclictest0-21swapper/312:36:533
2820464992119,1cyclictest0-21swapper/312:13:423
2820464992119,1cyclictest0-21swapper/312:05:573
2820464992119,1cyclictest0-21swapper/311:16:443
2820464992119,1cyclictest0-21swapper/307:55:273
2820464992112,7cyclictest2865278-21munin-run09:15:003
282046499210,20cyclictest3056-21PK-Backend11:56:253
282046499210,20cyclictest3056-21PK-Backend11:34:213
282046499210,20cyclictest3056-21PK-Backend08:29:553
282046499210,20cyclictest0-21swapper/310:02:423
282046499210,20cyclictest0-21swapper/309:50:253
282046499210,19cyclictest3056-21PK-Backend09:41:123
282046499210,19cyclictest3056-21PK-Backend07:21:483
2820457992119,1cyclictest0-21swapper/210:27:152
2820457992119,1cyclictest0-21swapper/210:27:142
2820457992115,4cyclictest978-21snmpd11:00:512
2820457992110,3cyclictest28560662cat08:45:222
282045799210,20cyclictest0-21swapper/211:51:102
282045799210,20cyclictest0-21swapper/210:47:302
282045799210,20cyclictest0-21swapper/209:37:272
2820456992119,1cyclictest3056-21PK-Backend11:08:271
2820456992119,1cyclictest3056-21PK-Backend10:05:481
2820456992119,1cyclictest3056-21PK-Backend08:33:481
2820456992119,1cyclictest0-21swapper/112:15:401
2820456992119,1cyclictest0-21swapper/111:27:201
2820456992119,1cyclictest0-21swapper/110:37:521
2820456992119,1cyclictest0-21swapper/109:41:071
2820456992119,1cyclictest0-21swapper/109:23:361
2820456992119,1cyclictest0-21swapper/109:00:311
2820456992119,1cyclictest0-21swapper/108:36:591
2820456992119,1cyclictest0-21swapper/108:24:001
2820456992119,1cyclictest0-21swapper/107:56:441
2820456992119,1cyclictest0-21swapper/107:31:501
2820456992118,2cyclictest3056-21PK-Backend09:47:431
2820456992115,4cyclictest2932457-21dump-pmu-power12:24:591
2820456992113,6cyclictest2910154-21ntpq11:20:171
282045699211,16cyclictest2873951-21perf09:40:001
282045699210,20cyclictest3056-21PK-Backend10:44:071
282045699210,20cyclictest0-21swapper/112:01:131
282045699210,20cyclictest0-21swapper/111:55:321
282045699210,19cyclictest3056-21PK-Backend12:14:381
282045699210,19cyclictest3056-21PK-Backend07:54:061
282044999210,20cyclictest0-21swapper/011:10:250
282044999210,19cyclictest2927275-21munin-plugin-st12:10:010
139099210,13rtkit-daemon0-21swapper/009:48:350
139099210,12rtkit-daemon0-21swapper/108:05:311
28805462200,4sleep13056-21PK-Backend09:55:191
2820464992018,1cyclictest3056-21PK-Backend10:35:473
2820464992018,1cyclictest3056-21PK-Backend10:28:453
2820464992018,1cyclictest3056-21PK-Backend10:28:453
2820464992018,1cyclictest3056-21PK-Backend09:02:403
2820464992018,1cyclictest3056-21PK-Backend08:31:303
2820464992018,1cyclictest0-21swapper/312:18:363
2820464992018,1cyclictest0-21swapper/310:55:493
2820464992015,3cyclictest2931141-21grep12:20:133
2820464992012,6cyclictest2836671-21sed07:50:203
282046499200,1cyclictest3056-21PK-Backend11:11:033
282046499200,1cyclictest3056-21PK-Backend08:15:013
282046499200,19cyclictest3056-21PK-Backend10:45:413
282046499200,19cyclictest3056-21PK-Backend09:08:273
282046499200,19cyclictest3056-21PK-Backend08:16:503
282046499200,19cyclictest0-21swapper/312:04:563
282046499200,19cyclictest0-21swapper/310:12:353
282045799209,9cyclictest2880422-21ntp_states09:55:182
2820457992018,1cyclictest0-21swapper/211:29:002
2820457992018,1cyclictest0-21swapper/210:39:112
2820457992018,1cyclictest0-21swapper/209:28:212
2820457992013,5cyclictest2905897-21sed11:10:012
282045799200,1cyclictest0-21swapper/207:40:382
282045799200,19cyclictest0-21swapper/211:55:022
282045799200,19cyclictest0-21swapper/211:40:352
282045799200,19cyclictest0-21swapper/211:32:522
282045799200,19cyclictest0-21swapper/210:51:222
282045799200,19cyclictest0-21swapper/210:11:402
282045799200,19cyclictest0-21swapper/210:02:342
282045799200,19cyclictest0-21swapper/209:14:012
282045799200,19cyclictest0-21swapper/209:05:232
282045799200,19cyclictest0-21swapper/208:12:082
282045799200,19cyclictest0-21swapper/207:51:212
2820456992018,1cyclictest3056-21PK-Backend10:45:081
2820456992018,1cyclictest3056-21PK-Backend10:17:171
2820456992018,1cyclictest3056-21PK-Backend09:53:311
2820456992018,1cyclictest3056-21PK-Backend08:40:101
2820456992018,1cyclictest0-21swapper/112:27:011
2820456992018,1cyclictest0-21swapper/110:21:431
2820456992018,1cyclictest0-21swapper/109:32:281
2820456992018,1cyclictest0-21swapper/108:10:021
2820456992018,1cyclictest0-21swapper/107:26:491
2820456992018,1cyclictest0-21swapper/107:26:491
2820456992010,8cyclictest883-21dbus-daemon07:45:011
282045699200,19cyclictest3056-21PK-Backend11:16:581
282045699200,19cyclictest3056-21PK-Backend10:56:171
282045699200,19cyclictest3056-21PK-Backend08:48:081
282045699200,19cyclictest0-21swapper/111:52:401
2820449992018,1cyclictest0-21swapper/012:25:080
2820449992018,1cyclictest0-21swapper/011:38:380
2820449992018,1cyclictest0-21swapper/007:30:230
282044999200,1cyclictest0-21swapper/011:24:250
282044999200,19cyclictest0-21swapper/011:56:280
282044999200,19cyclictest0-21swapper/011:43:170
282044999200,19cyclictest0-21swapper/010:57:130
282044999200,19cyclictest0-21swapper/010:46:530
282044999200,19cyclictest0-21swapper/010:41:260
282044999200,19cyclictest0-21swapper/009:20:070
282044999200,19cyclictest0-21swapper/009:06:270
139099200,16rtkit-daemon0-21swapper/209:17:192
282046499199,8cyclictest436-20systemd-journal11:40:013
2820464991917,1cyclictest3056-21PK-Backend07:33:573
2820464991917,1cyclictest0-21swapper/310:30:333
2820464991917,1cyclictest0-21swapper/308:58:273
2820464991917,1cyclictest0-21swapper/308:02:303
2820464991916,2cyclictest3056-21PK-Backend11:47:193
282046499190,18cyclictest0-21swapper/309:59:043
2820457991917,1cyclictest0-21swapper/212:32:072
2820457991917,1cyclictest0-21swapper/212:08:402
2820457991917,1cyclictest0-21swapper/210:40:122
2820457991917,1cyclictest0-21swapper/210:08:022
2820457991917,1cyclictest0-21swapper/209:24:412
2820457991917,1cyclictest0-21swapper/208:55:562
2820457991917,1cyclictest0-21swapper/208:52:312
2820457991917,1cyclictest0-21swapper/208:05:402
2820457991917,1cyclictest0-21swapper/207:55:472
2820457991917,1cyclictest0-21swapper/207:29:242
2820457991917,1cyclictest0-21swapper/207:29:242
2820457991914,3cyclictest2852296-21cat08:35:212
282045799190,1cyclictest0-21swapper/212:22:192
282045799190,1cyclictest0-21swapper/212:17:262
282045799190,1cyclictest0-21swapper/210:32:432
282045799190,1cyclictest0-21swapper/207:45:062
282045799190,1cyclictest0-21swapper/207:12:542
282045799190,18cyclictest0-21swapper/211:17:242
282045799190,18cyclictest0-21swapper/208:40:562
282045799190,18cyclictest0-21swapper/208:17:502
282045799190,18cyclictest0-21swapper/208:04:392
282045699199,8cyclictest436-20systemd-journal07:24:591
2820456991917,1cyclictest3056-21PK-Backend12:35:341
2820456991917,1cyclictest3056-21PK-Backend10:10:141
2820456991917,1cyclictest0-21swapper/111:33:011
2820456991917,1cyclictest0-21swapper/108:01:581
2820456991912,5cyclictest436-20systemd-journal10:25:401
2820456991912,5cyclictest436-20systemd-journal10:25:401
282045699190,1cyclictest3056-21PK-Backend08:55:301
282045699190,1cyclictest0-21swapper/112:05:051
282045699190,1cyclictest0-21swapper/111:35:521
282045699190,18cyclictest3056-21PK-Backend12:31:411
2820449991917,1cyclictest0-21swapper/012:37:310
2820449991917,1cyclictest0-21swapper/012:00:200
2820449991917,1cyclictest0-21swapper/011:51:490
2820449991917,1cyclictest0-21swapper/011:19:450
2820449991917,1cyclictest0-21swapper/010:12:460
2820449991917,1cyclictest0-21swapper/010:05:420
2820449991917,1cyclictest0-21swapper/009:54:140
2820449991917,1cyclictest0-21swapper/009:36:490
2820449991917,1cyclictest0-21swapper/009:17:300
2820449991917,1cyclictest0-21swapper/008:28:360
2820449991917,1cyclictest0-21swapper/008:10:250
2820449991917,1cyclictest0-21swapper/007:51:050
2820449991915,3cyclictest13-21ksoftirqd/007:20:010
282044999190,1cyclictest0-21swapper/011:31:060
282044999190,1cyclictest0-21swapper/011:01:530
282044999190,1cyclictest0-21swapper/010:51:330
282044999190,1cyclictest0-21swapper/010:24:150
282044999190,1cyclictest0-21swapper/009:44:130
282044999190,1cyclictest0-21swapper/009:33:110
282044999190,1cyclictest0-21swapper/009:28:460
282044999190,1cyclictest0-21swapper/008:20:320
282044999190,1cyclictest0-21swapper/008:19:310
282044999190,18cyclictest2928999-21turbostat12:15:000
282044999190,18cyclictest0-21swapper/012:21:160
282044999190,18cyclictest0-21swapper/011:25:250
282044999190,18cyclictest0-21swapper/010:34:080
282044999190,18cyclictest0-21swapper/009:02:160
282044999190,18cyclictest0-21swapper/008:49:520
282044999190,18cyclictest0-21swapper/008:09:230
282044999190,18cyclictest0-21swapper/008:03:070
282044999190,18cyclictest0-21swapper/007:47:260
282046499182,7cyclictest2855060-21apt-get08:45:043
2820464991816,1cyclictest3056-21PK-Backend08:06:083
2820464991815,2cyclictest3056-21PK-Backend08:23:193
2820464991814,2cyclictest2916629-21systemd-run11:40:003
2820464991811,5cyclictest2852357-21cat08:35:213
282046499180,16cyclictest2857356-21awk08:50:163
2820457991816,1cyclictest0-21swapper/210:59:052
2820457991816,1cyclictest0-21swapper/209:40:042
2820457991816,1cyclictest0-21swapper/208:22:442
2820457991816,1cyclictest0-21swapper/207:38:022
2820457991814,3cyclictest28650irq/123-ahci[0012:05:012
2820457991812,4cyclictest2888795-21if_enp2s010:20:152
2820457991812,4cyclictest1095-21runrttasks09:00:132
2820457991811,5cyclictest436-20systemd-journal09:50:002
2820457991811,5cyclictest2887724-21sshd10:15:412
2820457991810,6cyclictest883-21dbus-daemon11:38:342
2820456991816,1cyclictest0-21swapper/111:43:221
2820456991816,1cyclictest0-21swapper/110:51:361
2820456991816,1cyclictest0-21swapper/110:31:371
2820456991812,4cyclictest2849366-21sh08:29:591
2820456991811,5cyclictest2845192-21awk08:15:201
2820449991816,1cyclictest0-21swapper/011:07:350
2820449991816,1cyclictest0-21swapper/010:17:120
2820449991816,1cyclictest0-21swapper/008:42:420
2820449991816,1cyclictest0-21swapper/007:39:360
2820449991811,5cyclictest2827163-21entropy07:25:150
2820449991811,5cyclictest2827163-21entropy07:25:140
282046499172,10cyclictest2824532-21perf07:20:013
2820464991715,1cyclictest3056-21PK-Backend11:22:253
282046499170,3cyclictest2896615-21users10:40:223
282045799177,5cyclictest2937811-21cut12:40:012
2820457991712,3cyclictest2870926-21cpuspeed_turbos09:30:122
2820457991710,5cyclictest2823893-21cut07:15:202
2820456991715,1cyclictest3056-21PK-Backend11:03:481
2820456991715,1cyclictest3056-21PK-Backend08:54:431
2820456991714,2cyclictest3056-21PK-Backend11:14:081
2820456991710,5cyclictest2831210-21ntp_kernel_err07:35:171
282044999179,6cyclictest2849976-21cat08:30:110
282044999179,6cyclictest2833373-21users07:40:230
2820449991715,1cyclictest0-21swapper/012:16:360
2820449991715,1cyclictest0-21swapper/011:48:580
2820449991715,1cyclictest0-21swapper/010:03:530
2820449991715,1cyclictest0-21swapper/007:20:360
2820449991714,2cyclictest3056-21PK-Backend07:57:060
282044999170,1cyclictest0-21swapper/009:56:510
282046499165,10cyclictest2889388-21grep10:20:223
2820464991614,1cyclictest3056-21PK-Backend07:38:583
2820464991610,4cyclictest3056-21PK-Backend09:37:303
282045799169,5cyclictest2829851-21users07:30:232
2820457991614,1cyclictest0-21swapper/208:30:352
282044999169,5cyclictest436-20systemd-journal08:55:000
2820449991611,4cyclictest2860065-21cron09:00:000
29213152150,2sleep33056-21PK-Backend11:50:193
2820457991513,1cyclictest0-21swapper/207:24:242
2820456991412,1cyclictest3056-21PK-Backend10:00:331
2820449991410,3cyclictest2934589-21cpuspeed_turbos12:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional