You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 21:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Apr 03, 2026 12:44:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6538692920,4sleep00-21swapper/012:15:120
5442412870,7sleep10-21swapper/107:05:211
54493328166,9sleep20-21swapper/207:08:402
54470127739,31sleep30-21swapper/307:05:403
54481226544,14sleep00-21swapper/007:07:060
5981952580,3sleep00-21swapper/009:35:170
6205782530,3sleep20-21swapper/210:40:112
5898472480,1chrt589846-21/usr/sbin/munin09:10:222
139099400,3rtkit-daemon3056-21PK-Backend08:16:571
139099400,3rtkit-daemon3056-21PK-Backend08:09:311
139099400,3rtkit-daemon0-21swapper/107:43:111
139099390,4rtkit-daemon3056-21PK-Backend07:49:541
139099390,3rtkit-daemon3056-21PK-Backend12:19:141
139099390,3rtkit-daemon3056-21PK-Backend07:58:171
139099390,3rtkit-daemon0-21swapper/111:58:441
139099390,3rtkit-daemon0-21swapper/111:38:321
139099380,3rtkit-daemon3056-21PK-Backend12:07:211
139099380,3rtkit-daemon3056-21PK-Backend08:36:451
139099380,3rtkit-daemon3056-21PK-Backend08:12:251
139099380,3rtkit-daemon0-21swapper/111:50:271
139099380,3rtkit-daemon0-21swapper/111:10:501
139099370,3rtkit-daemon3056-21PK-Backend11:24:571
139099370,3rtkit-daemon3056-21PK-Backend11:01:221
139099370,3rtkit-daemon3056-21PK-Backend09:22:321
139099370,3rtkit-daemon3056-21PK-Backend08:04:111
139099370,3rtkit-daemon0-21swapper/112:00:391
139099360,3rtkit-daemon3056-21PK-Backend10:12:541
139099360,3rtkit-daemon3056-21PK-Backend07:23:221
139099350,3rtkit-daemon3056-21PK-Backend12:34:571
5995532340,3sleep10-21swapper/109:40:121
139099310,7rtkit-daemon630482-21taskset11:09:530
6133492270,4sleep03056-21PK-Backend10:20:010
54517599250,23cyclictest639183-21perf11:35:000
545186992419,3cyclictest2176-21JS10:27:483
545182992418,4cyclictest661654-21python312:35:192
545182992415,7cyclictest611047-21users10:10:222
545182992411,11cyclictest656815-21unin-run12:24:592
54517899240,21cyclictest436-20systemd-journal09:07:401
545182992314,7cyclictest627668-21df11:00:132
545175992316,5cyclictest604236-21cron09:55:010
139099230,15rtkit-daemon3056-21PK-Backend09:25:100
545186992220,1cyclictest0-21swapper/311:08:013
545186992220,1cyclictest0-21swapper/310:00:423
545186992220,1cyclictest0-21swapper/309:40:263
54518699220,21cyclictest0-21swapper/310:25:023
545182992214,6cyclictest654433-21python312:15:212
545182992214,6cyclictest1-21systemd11:00:012
545178992220,1cyclictest3056-21PK-Backend11:18:071
545178992220,1cyclictest3056-21PK-Backend10:39:351
545178992214,6cyclictest883-21dbus-daemon08:55:001
545175992220,1cyclictest0-21swapper/012:22:190
545175992220,1cyclictest0-21swapper/010:28:350
545175992220,1cyclictest0-21swapper/009:11:370
545175992219,2cyclictest3056-21PK-Backend09:45:440
545175992216,4cyclictest647858-21turbostat12:00:010
545175992215,5cyclictest642675-21systemd-run11:45:010
54517599220,21cyclictest0-21swapper/010:34:030
139099220,14rtkit-daemon0-21swapper/111:43:041
139099220,14rtkit-daemon0-21swapper/007:36:540
545186992119,1cyclictest3056-21PK-Backend11:47:483
545186992119,1cyclictest0-21swapper/312:24:253
545186992119,1cyclictest0-21swapper/311:22:553
545186992119,1cyclictest0-21swapper/310:48:553
545186992119,1cyclictest0-21swapper/309:56:293
545186992119,1cyclictest0-21swapper/309:29:053
545186992119,1cyclictest0-21swapper/309:18:443
545186992119,1cyclictest0-21swapper/308:25:513
545186992119,1cyclictest0-21swapper/308:11:103
54518699210,20cyclictest3056-21PK-Backend09:31:153
54518699210,20cyclictest0-21swapper/312:29:333
54518699210,20cyclictest0-21swapper/310:38:473
54518699210,20cyclictest0-21swapper/309:46:563
54518699210,20cyclictest0-21swapper/308:32:003
54518699210,20cyclictest0-21swapper/307:39:403
545182992119,1cyclictest0-21swapper/212:12:352
545182992119,1cyclictest0-21swapper/211:45:312
545182992119,1cyclictest0-21swapper/211:25:032
545182992119,1cyclictest0-21swapper/209:42:492
545182992119,1cyclictest0-21swapper/209:08:352
545182992119,1cyclictest0-21swapper/209:04:232
545182992119,1cyclictest0-21swapper/208:26:582
545182992118,2cyclictest614897-21cron10:25:002
545182992114,5cyclictest605381-21python309:55:212
545182992113,6cyclictest1-21systemd09:19:592
54518299210,2cyclictest547975-21diskstats07:15:132
545178992119,1cyclictest3056-21PK-Backend10:43:131
545178992119,1cyclictest3056-21PK-Backend08:41:061
545178992119,1cyclictest3056-21PK-Backend07:16:431
545178992119,1cyclictest3056-21PK-Backend07:14:341
545178992119,1cyclictest0-21swapper/110:50:301
545178992119,1cyclictest0-21swapper/108:57:071
545178992118,2cyclictest3056-21PK-Backend10:27:531
545178992118,2cyclictest3056-21PK-Backend09:18:371
545178992118,2cyclictest0-21swapper/109:10:191
54517899210,19cyclictest3056-21PK-Backend12:14:191
54517899210,19cyclictest3056-21PK-Backend10:56:461
54517899210,19cyclictest3056-21PK-Backend10:18:591
54517899210,19cyclictest3056-21PK-Backend09:58:311
545175992119,1cyclictest3056-21PK-Backend11:25:270
545175992119,1cyclictest3056-21PK-Backend07:31:110
545175992119,1cyclictest0-21swapper/011:37:170
545175992119,1cyclictest0-21swapper/011:18:310
545175992119,1cyclictest0-21swapper/011:03:380
545175992119,1cyclictest0-21swapper/010:05:510
545175992119,1cyclictest0-21swapper/009:41:250
545175992119,1cyclictest0-21swapper/008:03:020
54517599210,20cyclictest0-21swapper/010:46:000
54517599210,20cyclictest0-21swapper/010:02:260
54517599210,20cyclictest0-21swapper/009:57:270
54517599210,20cyclictest0-21swapper/008:59:130
54517599210,20cyclictest0-21swapper/008:47:310
54517599210,20cyclictest0-21swapper/008:05:050
54517599210,1cyclictest0-21swapper/010:23:090
54517599210,19cyclictest3056-21PK-Backend09:15:020
139099210,14rtkit-daemon3056-21PK-Backend10:03:451
139099210,14rtkit-daemon0-21swapper/108:22:221
545186992018,1cyclictest3056-21PK-Backend07:43:333
545186992018,1cyclictest0-21swapper/311:10:043
545186992018,1cyclictest0-21swapper/309:11:143
545186992018,1cyclictest0-21swapper/308:17:543
545186992018,1cyclictest0-21swapper/307:49:143
545186992018,1cyclictest0-21swapper/307:10:283
545186992015,3cyclictest580555-21python308:45:193
54518699201,4cyclictest576205-21/usr/sbin/munin08:35:123
545186992013,5cyclictest548659-21cat07:15:203
545186992012,6cyclictest436-20systemd-journal12:40:003
545186992012,6cyclictest1-21systemd08:55:013
54518699200,1cyclictest3056-21PK-Backend11:32:403
54518699200,1cyclictest3056-21PK-Backend09:05:253
54518699200,1cyclictest0-21swapper/312:33:393
54518699200,1cyclictest0-21swapper/307:59:353
54518699200,19cyclictest3056-21PK-Backend07:27:243
54518699200,19cyclictest0-21swapper/309:50:413
54518699200,19cyclictest0-21swapper/309:39:383
54518699200,19cyclictest0-21swapper/308:22:473
54518699200,19cyclictest0-21swapper/307:22:043
54518299207,12cyclictest623575-21sh10:50:012
545182992018,1cyclictest0-21swapper/212:05:252
545182992018,1cyclictest0-21swapper/209:52:422
545182992018,1cyclictest0-21swapper/209:45:452
545182992018,1cyclictest0-21swapper/209:32:482
545182992018,1cyclictest0-21swapper/209:23:362
545182992018,1cyclictest0-21swapper/208:46:032
545182992018,1cyclictest0-21swapper/208:16:562
545182992018,1cyclictest0-21swapper/208:00:422
545182992018,1cyclictest0-21swapper/207:30:272
545182992018,1cyclictest0-21swapper/207:23:172
545182992015,3cyclictest618810-21tr10:35:122
545182992015,3cyclictest606377-21tr10:00:122
545182992013,5cyclictest634972-21ntpq11:20:182
545182992012,6cyclictest556720-21fw_packets07:40:142
54518299200,1cyclictest3056-21PK-Backend11:30:562
54518299200,19cyclictest0-21swapper/211:16:042
54518299200,19cyclictest0-21swapper/210:51:372
54518299200,19cyclictest0-21swapper/210:27:302
54518299200,19cyclictest0-21swapper/210:05:202
54518299200,19cyclictest0-21swapper/209:28:292
54518299200,19cyclictest0-21swapper/208:53:002
54518299200,19cyclictest0-21swapper/207:55:482
54518299200,19cyclictest0-21swapper/207:45:262
545178992018,1cyclictest3056-21PK-Backend09:49:331
545178992018,1cyclictest0-21swapper/107:33:471
54517899200,1cyclictest3056-21PK-Backend10:21:361
54517899200,19cyclictest3056-21PK-Backend12:23:181
54517899200,19cyclictest3056-21PK-Backend07:52:251
54517899200,19cyclictest0-21swapper/110:45:021
54517899200,19cyclictest0-21swapper/107:35:361
54517599208,5cyclictest141rcu_preempt07:15:020
545175992018,1cyclictest0-21swapper/012:13:050
545175992018,1cyclictest0-21swapper/010:35:050
545175992018,1cyclictest0-21swapper/008:43:450
545175992018,1cyclictest0-21swapper/008:21:080
545175992018,1cyclictest0-21swapper/007:21:050
54517599200,1cyclictest0-21swapper/011:11:350
54517599200,19cyclictest3056-21PK-Backend08:10:330
54517599200,19cyclictest0-21swapper/007:58:090
139099200,13rtkit-daemon0-21swapper/011:47:390
139099200,13rtkit-daemon0-21swapper/009:34:220
54518699192,15cyclictest0-21swapper/312:10:023
545186991917,1cyclictest3056-21PK-Backend07:34:133
545186991917,1cyclictest0-21swapper/311:00:023
545186991917,1cyclictest0-21swapper/310:41:383
545186991917,1cyclictest0-21swapper/310:31:303
545186991917,1cyclictest0-21swapper/308:06:303
545186991917,1cyclictest0-21swapper/307:50:163
545186991914,3cyclictest2156-21gnome-shell11:59:083
545186991913,4cyclictest613444-21apt10:20:123
545186991912,5cyclictest612422-21ntpq10:15:183
54518699190,7cyclictest565332-21munin-run08:05:013
54518699190,1cyclictest3056-21PK-Backend11:42:423
54518699190,1cyclictest3056-21PK-Backend08:55:053
54518699190,1cyclictest0-21swapper/311:17:003
54518699190,1cyclictest0-21swapper/310:59:013
54518699190,1cyclictest0-21swapper/310:14:203
54518699190,1cyclictest0-21swapper/309:22:503
545182991917,1cyclictest0-21swapper/211:39:082
545182991917,1cyclictest0-21swapper/207:51:092
545182991914,3cyclictest1352-21snapd08:05:352
545182991912,5cyclictest578428-21interrupts08:40:162
54518299190,1cyclictest3056-21PK-Backend11:59:022
54518299190,1cyclictest0-21swapper/212:26:532
54518299190,1cyclictest0-21swapper/208:21:502
54518299190,1cyclictest0-21swapper/208:10:152
54518299190,1cyclictest0-21swapper/207:37:442
54518299190,18cyclictest0-21swapper/211:14:012
54518299190,18cyclictest0-21swapper/211:06:022
54518299190,18cyclictest0-21swapper/210:30:212
54518299190,18cyclictest0-21swapper/209:36:202
545178991917,1cyclictest3056-21PK-Backend11:08:221
545178991917,1cyclictest3056-21PK-Backend10:31:311
545178991915,3cyclictest1095-21runrttasks09:04:341
545178991911,6cyclictest575353-21sensors_temp08:30:201
54517899190,1cyclictest3056-21PK-Backend10:08:331
54517899190,1cyclictest0-21swapper/109:30:201
545175991917,1cyclictest0-21swapper/012:35:360
545175991917,1cyclictest0-21swapper/007:53:300
545175991917,1cyclictest0-21swapper/007:41:200
545175991912,5cyclictest634890-21needreboot11:20:160
54517599190,1cyclictest0-21swapper/009:05:480
54517599190,1cyclictest0-21swapper/007:48:500
54517599190,1cyclictest0-21swapper/007:29:220
54517599190,18cyclictest0-21swapper/012:04:550
545186991816,1cyclictest3056-21PK-Backend11:50:523
545186991816,1cyclictest0-21swapper/310:51:453
545186991812,4cyclictest2630-21gdbus12:19:543
545186991810,6cyclictest650206-21df12:05:133
545182991813,3cyclictest649575-21latency_hist12:05:002
545182991813,3cyclictest576229-21apt08:35:112
545182991811,5cyclictest660076-21cat12:30:202
545182991811,5cyclictest612045-21expr10:15:122
545182991811,5cyclictest546117-21cat07:10:172
54517899189,7cyclictest658568-21unin-run12:30:001
545178991816,1cyclictest0-21swapper/111:34:381
545178991813,3cyclictest551840-21open_inodes07:25:181
545175991816,1cyclictest3056-21PK-Backend12:30:300
545175991816,1cyclictest0-21swapper/012:26:250
545175991816,1cyclictest0-21swapper/009:21:510
545175991812,4cyclictest627041-21perf11:00:000
54517599180,3cyclictest651310-21perf12:10:010
54517599180,1cyclictest0-21swapper/008:19:050
54517599180,17cyclictest0-21swapper/010:53:160
545186991715,1cyclictest0-21swapper/309:00:393
545186991713,2cyclictest607984-21apt10:05:123
545186991712,4cyclictest42-21ksoftirqd/308:40:183
545182991712,4cyclictest583559-21tr08:55:112
54517599179,6cyclictest883-21dbus-daemon08:54:520
545175991715,1cyclictest0-21swapper/010:42:220
545175991711,4cyclictest436-20systemd-journal11:55:000
545186991612,3cyclictest0-21swapper/312:00:203
545182991610,4cyclictest645197-21cat11:50:172
545178991614,1cyclictest3056-21PK-Backend08:26:451
545178991614,1cyclictest0-21swapper/109:36:011
545178991611,3cyclictest594248-21cpuspeed_turbos09:25:101
54517599169,5cyclictest576241-21grep08:35:100
545175991614,1cyclictest3056-21PK-Backend10:11:530
545175991614,1cyclictest0-21swapper/008:34:260
545182991513,1cyclictest0-21swapper/207:25:402
545182991511,3cyclictest574974-21irqstats08:30:162
54517899158,5cyclictest643466-21cat11:45:161
54517899158,5cyclictest636879-21cat11:25:221
54517599158,5cyclictest584902-21apt-get09:00:010
54518299149,3cyclictest886-21NetworkManager11:45:002
54517899149,3cyclictest603795-21cat09:50:221
545178991412,1cyclictest3056-21PK-Backend08:47:481
545175991412,1cyclictest3056-21PK-Backend08:25:130
545175991412,1cyclictest0-21swapper/007:11:050
545186991311,1cyclictest3056-21PK-Backend11:35:463
54517899120,2cyclictest3056-21PK-Backend12:35:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional