You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 01:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Wed Apr 22, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30672642990,3sleep20-21swapper/212:00:132
139099860,52rtkit-daemon0-21swapper/107:08:201
296322327753,18sleep00-21swapper/007:06:030
296336526444,14sleep20-21swapper/207:07:542
296325826443,14sleep30-21swapper/307:06:313
30220472530,4sleep33056-21PK-Backend09:50:233
30387342500,3sleep10-21swapper/110:40:011
30750202440,2sleep33056-21PK-Backend12:20:193
139099440,3rtkit-daemon0-21swapper/110:42:181
30009832410,4sleep33056-21PK-Backend08:55:003
30132392310,2sleep00-21swapper/009:25:220
139099310,5rtkit-daemon1389-21rtkit-daemon11:40:520
296368099259,14cyclictest3056-21PK-Backend10:59:073
2963670992514,8cyclictest883-21dbus-daemon12:05:010
296367099250,8cyclictest3038838-21taskset10:40:120
139099250,4rtkit-daemon1389-21rtkit-daemon12:10:441
29716322240,3sleep33056-21PK-Backend07:30:123
2963670992421,2cyclictest161rcuc/011:28:190
2963670992417,6cyclictest3045479-21cron10:59:590
139099240,15rtkit-daemon0-21swapper/108:55:021
2963680992320,2cyclictest3056-21PK-Backend07:55:053
296368099230,21cyclictest3056-21PK-Backend08:03:173
2963676992321,1cyclictest0-21swapper/211:39:502
2963673992321,1cyclictest0-21swapper/110:55:181
2963673992315,6cyclictest2968201-21df07:20:141
296367399230,21cyclictest3072475-21hddtemp_smartct12:15:131
296367099233,6cyclictest13-21ksoftirqd/007:22:130
2963670992320,2cyclictest161rcuc/011:12:350
2963670992320,2cyclictest161rcuc/007:36:100
30601892220,3chrt0-21swapper/211:40:132
2963680992220,1cyclictest3056-21PK-Backend11:02:573
296368099220,20cyclictest3056-21PK-Backend10:15:533
296368099220,20cyclictest3056-21PK-Backend07:40:333
2963676992220,1cyclictest0-21swapper/212:05:252
2963676992220,1cyclictest0-21swapper/211:56:342
2963676992220,1cyclictest0-21swapper/210:45:432
2963676992220,1cyclictest0-21swapper/210:10:342
2963676992220,1cyclictest0-21swapper/210:07:172
2963676992220,1cyclictest0-21swapper/209:49:322
2963676992220,1cyclictest0-21swapper/208:28:212
2963676992220,1cyclictest0-21swapper/207:41:572
2963676992218,3cyclictest3000824-21apt-get08:55:032
296367699220,21cyclictest0-21swapper/212:22:502
296367699220,21cyclictest0-21swapper/211:24:092
296367699220,21cyclictest0-21swapper/209:45:002
2963673992220,1cyclictest0-21swapper/110:05:231
2963673992220,1cyclictest0-21swapper/107:14:131
2963673992211,9cyclictest883-21dbus-daemon09:47:461
296367399220,21cyclictest0-21swapper/109:20:341
296367099226,5cyclictest13-21ksoftirqd/007:30:120
2963670992220,1cyclictest0-21swapper/010:46:350
2963670992220,1cyclictest0-21swapper/009:52:200
2963670992220,1cyclictest0-21swapper/009:49:020
2963670992219,2cyclictest161rcuc/011:59:020
2963670992215,5cyclictest3070069-21cron12:10:000
296367099220,6cyclictest3023165-21/usr/sbin/munin09:55:160
296367099220,21cyclictest0-21swapper/010:21:340
139099220,4rtkit-daemon1389-21rtkit-daemon11:31:030
139099220,3rtkit-daemon1389-21rtkit-daemon12:29:210
139099220,14rtkit-daemon0-21swapper/111:06:311
139099220,14rtkit-daemon0-21swapper/111:06:301
2963680992119,1cyclictest3056-21PK-Backend10:05:243
2963680992119,1cyclictest3056-21PK-Backend09:06:243
2963680992119,1cyclictest3056-21PK-Backend08:47:593
2963680992119,1cyclictest3056-21PK-Backend07:26:533
2963680992118,2cyclictest3056-21PK-Backend07:18:223
296368099210,20cyclictest3056-21PK-Backend12:27:123
296368099210,20cyclictest3056-21PK-Backend09:35:173
296368099210,20cyclictest3056-21PK-Backend09:27:333
296368099210,19cyclictest3056-21PK-Backend11:30:363
296368099210,19cyclictest3056-21PK-Backend11:20:413
296368099210,19cyclictest3056-21PK-Backend10:40:403
296368099210,19cyclictest3056-21PK-Backend10:28:173
296368099210,19cyclictest3056-21PK-Backend07:35:123
2963676992119,1cyclictest0-21swapper/211:02:392
2963676992119,1cyclictest0-21swapper/210:54:352
2963676992119,1cyclictest0-21swapper/210:41:092
2963676992119,1cyclictest0-21swapper/209:20:182
2963676992119,1cyclictest0-21swapper/209:18:162
2963676992119,1cyclictest0-21swapper/208:54:032
2963676992119,1cyclictest0-21swapper/208:40:182
2963676992119,1cyclictest0-21swapper/208:22:542
2963676992119,1cyclictest0-21swapper/207:54:212
2963676992119,1cyclictest0-21swapper/207:16:022
2963676992118,2cyclictest3056-21PK-Backend08:17:262
296367699210,20cyclictest0-21swapper/212:28:572
296367699210,20cyclictest0-21swapper/209:37:022
296367699210,20cyclictest0-21swapper/209:26:132
296367699210,20cyclictest0-21swapper/208:01:572
2963673992119,1cyclictest3056-21PK-Backend10:23:401
2963673992119,1cyclictest0-21swapper/112:01:561
2963673992119,1cyclictest0-21swapper/111:41:071
2963673992119,1cyclictest0-21swapper/111:23:231
2963673992119,1cyclictest0-21swapper/111:17:491
2963673992119,1cyclictest0-21swapper/110:54:021
2963673992119,1cyclictest0-21swapper/108:45:061
296367399210,20cyclictest0-21swapper/108:25:181
296367399210,20cyclictest0-21swapper/107:27:461
2963670992119,1cyclictest0-21swapper/012:21:310
2963670992119,1cyclictest0-21swapper/011:51:090
2963670992119,1cyclictest0-21swapper/010:36:280
2963670992119,1cyclictest0-21swapper/010:25:040
2963670992119,1cyclictest0-21swapper/009:07:530
2963670992119,1cyclictest0-21swapper/008:35:080
2963670992119,1cyclictest0-21swapper/008:29:400
2963670992119,1cyclictest0-21swapper/008:11:220
2963670992119,1cyclictest0-21swapper/007:15:300
2963670992119,1cyclictest0-21swapper/007:11:190
296367099211,5cyclictest3026166-21apt10:05:100
296367099211,17cyclictest2999104-21latency_hist08:50:000
296367099210,20cyclictest0-21swapper/011:17:570
296367099210,20cyclictest0-21swapper/009:42:390
296367099210,20cyclictest0-21swapper/009:01:240
296367099210,20cyclictest0-21swapper/007:27:070
139099210,13rtkit-daemon0-21swapper/011:20:180
29874422200,4sleep03056-21PK-Backend08:15:120
2963680992018,1cyclictest3056-21PK-Backend12:12:063
2963680992018,1cyclictest3056-21PK-Backend11:42:323
2963680992018,1cyclictest3056-21PK-Backend11:38:133
2963680992018,1cyclictest3056-21PK-Backend11:17:233
2963680992018,1cyclictest3056-21PK-Backend10:37:213
2963680992018,1cyclictest3056-21PK-Backend07:20:513
2963680992014,4cyclictest2984993-21munin-run08:10:003
296368099200,1cyclictest0-21swapper/307:48:303
296368099200,19cyclictest3056-21PK-Backend11:11:503
296368099200,19cyclictest3056-21PK-Backend11:05:143
296368099200,19cyclictest3056-21PK-Backend11:05:143
296368099200,19cyclictest3056-21PK-Backend10:00:053
296368099200,19cyclictest3056-21PK-Backend09:34:163
296368099200,19cyclictest3056-21PK-Backend09:01:443
296368099200,19cyclictest3056-21PK-Backend08:57:053
296368099200,19cyclictest3056-21PK-Backend08:22:093
296368099200,19cyclictest0-21swapper/309:15:563
2963676992018,1cyclictest0-21swapper/212:16:422
2963676992018,1cyclictest0-21swapper/211:34:162
2963676992018,1cyclictest0-21swapper/211:25:232
2963676992018,1cyclictest0-21swapper/210:55:502
2963676992018,1cyclictest0-21swapper/210:15:552
2963676992018,1cyclictest0-21swapper/209:06:272
2963676992018,1cyclictest0-21swapper/208:11:242
2963676992018,1cyclictest0-21swapper/208:08:482
296367699200,1cyclictest0-21swapper/207:29:272
296367699200,1cyclictest0-21swapper/207:24:062
296367699200,19cyclictest0-21swapper/211:51:002
296367699200,19cyclictest0-21swapper/211:19:362
296367699200,19cyclictest0-21swapper/210:33:062
296367699200,19cyclictest0-21swapper/208:47:342
296367699200,19cyclictest0-21swapper/207:31:012
2963673992018,1cyclictest3056-21PK-Backend10:32:471
2963673992018,1cyclictest0-21swapper/111:12:141
2963673992018,1cyclictest0-21swapper/110:28:131
2963673992018,1cyclictest0-21swapper/109:56:431
2963673992018,1cyclictest0-21swapper/109:53:251
2963673992018,1cyclictest0-21swapper/108:23:291
2963673992018,1cyclictest0-21swapper/107:40:501
2963673992018,1cyclictest0-21swapper/107:38:261
296367399201,17cyclictest3062335-21cut11:45:151
296367399200,19cyclictest0-21swapper/111:58:381
296367399200,19cyclictest0-21swapper/111:52:031
296367399200,19cyclictest0-21swapper/111:32:151
296367399200,19cyclictest0-21swapper/111:25:401
296367399200,19cyclictest0-21swapper/108:19:511
296367399200,19cyclictest0-21swapper/107:18:271
296367099203,7cyclictest13-21ksoftirqd/007:53:060
2963670992018,1cyclictest0-21swapper/012:13:210
2963670992018,1cyclictest0-21swapper/011:48:530
2963670992018,1cyclictest0-21swapper/008:41:230
2963670992018,1cyclictest0-21swapper/007:56:210
296367099200,1cyclictest0-21swapper/012:15:230
296367099200,19cyclictest3056-21PK-Backend08:07:570
296367099200,19cyclictest0-21swapper/009:38:470
296367099200,19cyclictest0-21swapper/009:32:060
296367099200,19cyclictest0-21swapper/009:16:370
296367099200,19cyclictest0-21swapper/008:31:290
2963680991917,1cyclictest3056-21PK-Backend12:06:113
2963680991917,1cyclictest3056-21PK-Backend08:37:173
2963680991917,1cyclictest3056-21PK-Backend08:32:513
2963680991917,1cyclictest0-21swapper/311:45:503
2963680991917,1cyclictest0-21swapper/310:21:273
2963680991917,1cyclictest0-21swapper/309:46:053
296368099190,1cyclictest3056-21PK-Backend12:19:013
296368099190,1cyclictest3056-21PK-Backend09:40:573
296368099190,1cyclictest3056-21PK-Backend09:14:563
296368099190,18cyclictest3056-21PK-Backend12:39:173
2963676991917,1cyclictest0-21swapper/212:11:352
2963676991917,1cyclictest0-21swapper/210:36:362
2963676991917,1cyclictest0-21swapper/210:03:592
2963676991917,1cyclictest0-21swapper/209:11:202
2963676991917,1cyclictest0-21swapper/208:31:582
2963676991917,1cyclictest0-21swapper/207:48:332
2963676991917,1cyclictest0-21swapper/207:12:572
2963676991912,5cyclictest2974556-21cron07:40:012
296367699190,1cyclictest0-21swapper/209:51:482
296367699190,1cyclictest0-21swapper/207:59:212
296367399197,3cyclictest30177842expr09:40:131
2963673991917,1cyclictest3056-21PK-Backend08:13:481
2963673991917,1cyclictest0-21swapper/112:30:361
2963673991917,1cyclictest0-21swapper/111:38:501
2963673991917,1cyclictest0-21swapper/111:02:071
2963673991917,1cyclictest0-21swapper/110:47:261
2963673991917,1cyclictest0-21swapper/110:00:021
2963673991917,1cyclictest0-21swapper/109:37:511
2963673991917,1cyclictest0-21swapper/109:31:081
2963673991913,4cyclictest2156-21gnome-shell08:38:091
296367399190,1cyclictest0-21swapper/109:11:491
296367399190,1cyclictest0-21swapper/108:51:211
296367399190,18cyclictest0-21swapper/112:09:051
296367399190,18cyclictest0-21swapper/108:31:341
296367399190,18cyclictest0-21swapper/107:45:371
2963670991917,1cyclictest0-21swapper/012:30:450
2963670991917,1cyclictest0-21swapper/010:31:540
2963670991917,1cyclictest0-21swapper/009:21:310
2963670991917,1cyclictest0-21swapper/008:51:150
2963670991917,1cyclictest0-21swapper/008:22:360
2963670991917,1cyclictest0-21swapper/008:02:570
296367099191,6cyclictest13-21ksoftirqd/009:14:490
2963670991911,6cyclictest3028643-21ntp_states10:10:190
296367099190,1cyclictest0-21swapper/011:02:160
296367099190,1cyclictest0-21swapper/008:56:440
2963680991816,1cyclictest3056-21PK-Backend12:31:193
2963680991816,1cyclictest3056-21PK-Backend11:59:483
2963680991816,1cyclictest3056-21PK-Backend11:54:273
2963680991816,1cyclictest3056-21PK-Backend11:26:153
2963680991816,1cyclictest3056-21PK-Backend08:28:243
2963680991816,1cyclictest0-21swapper/308:10:073
2963680991815,2cyclictest3056-21PK-Backend10:45:133
2963680991812,4cyclictest0-21swapper/310:30:033
2963676991816,1cyclictest3056-21PK-Backend09:00:452
2963676991816,1cyclictest0-21swapper/210:28:332
2963676991816,1cyclictest0-21swapper/210:20:292
2963676991814,3cyclictest978-21snmpd08:39:022
296367399189,7cyclictest2980775-21ntp_states07:55:191
296367399189,6cyclictest26-21ksoftirqd/112:25:121
2963673991816,1cyclictest0-21swapper/112:35:421
2963673991816,1cyclictest0-21swapper/112:20:211
2963673991816,1cyclictest0-21swapper/110:13:481
296367399180,1cyclictest0-21swapper/109:19:331
296367099183,6cyclictest13-21ksoftirqd/010:51:540
296367099183,10cyclictest2156-21gnome-shell12:35:090
2963670991816,1cyclictest0-21swapper/011:36:570
2963670991816,1cyclictest0-21swapper/010:19:170
296367099181,4cyclictest2975306-21irqstats07:40:150
2963680991715,1cyclictest3056-21PK-Backend12:04:073
2963680991715,1cyclictest3056-21PK-Backend07:14:103
296367699179,6cyclictest436-20systemd-journal12:35:002
296367699175,3cyclictest141rcu_preempt12:40:002
2963676991715,1cyclictest0-21swapper/211:47:422
2963676991715,1cyclictest0-21swapper/211:14:022
2963676991715,1cyclictest0-21swapper/211:09:282
2963676991715,1cyclictest0-21swapper/211:09:282
296367399179,6cyclictest3031101-21apt-get10:19:591
296367399172,11cyclictest2971309-21apt07:30:111
2963673991715,1cyclictest0-21swapper/108:43:151
2963673991712,4cyclictest26-21ksoftirqd/109:00:191
2963673991712,3cyclictest2982464-21netstat08:00:181
2963673991710,5cyclictest3005208-21grep09:05:111
296367099179,6cyclictest2976938-21sshd07:45:130
296367099170,6cyclictest13-21ksoftirqd/011:07:420
296367099170,6cyclictest13-21ksoftirqd/011:07:420
2963680991614,1cyclictest3056-21PK-Backend08:43:333
2963680991610,5cyclictest2987813-21ls08:15:173
296367399168,6cyclictest2978295-21apt07:50:091
2963673991611,3cyclictest3012925-21needreboot09:25:181
296367099160,6cyclictest13-21ksoftirqd/010:00:310
2963680991513,1cyclictest3056-21PK-Backend09:59:033
2963680991513,1cyclictest3056-21PK-Backend09:21:523
2963680991512,2cyclictest3056-21PK-Backend10:13:503
2963680991510,3cyclictest3056-21PK-Backend07:50:043
296367699159,5cyclictest3023116-21cat09:55:162
2963676991511,2cyclictest34-21ksoftirqd/209:30:182
296367399158,5cyclictest2983477-21cat08:05:101
2963680991412,1cyclictest3056-21PK-Backend10:50:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional