You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 09:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Fri Aug 07, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
33515621270,2sleep20-21swapper/221:45:012
28411521160,4sleep13056-21PK-Backend19:15:221
28059721150,3sleep13056-21PK-Backend19:10:021
35346821030,4sleep13056-21PK-Backend22:35:161
139099850,52rtkit-daemon0-21swapper/319:09:443
28042627439,13sleep00-21swapper/019:09:050
28048126641,18sleep20-21swapper/219:09:472
3711512490,4sleep20-21swapper/223:25:172
3656872490,3sleep10-21swapper/123:10:161
3513712390,2sleep30-21swapper/322:30:123
3888482380,3sleep00-21swapper/000:15:240
3424792370,4sleep03056-21PK-Backend22:05:120
3625172270,3sleep00-21swapper/023:00:220
28066099274,11cyclictest3225121timerandwakeup21:05:212
28066099272,6cyclictest0-21swapper/220:45:002
139099270,17rtkit-daemon1788620-21WebKitWebProces22:24:073
139099250,18rtkit-daemon1317-21systemd00:00:352
280660992414,9cyclictest294953-21unin-run19:50:002
280663992314,7cyclictest300992-21cat20:05:173
28066099233,6cyclictest377511-21apt23:45:112
28066099232,9cyclictest328191-21idleruntime-cro21:25:002
28066099232,9cyclictest328191-21idleruntime-cro21:25:002
280657992315,6cyclictest378702-21sshd23:46:441
28065799230,21cyclictest3056-21PK-Backend20:02:081
139099230,3rtkit-daemon0-21swapper/321:54:423
139099230,17rtkit-daemon3056-21PK-Backend23:07:442
139099230,16rtkit-daemon3056-21PK-Backend20:29:283
139099230,15rtkit-daemon3056-21PK-Backend23:47:253
139099230,15rtkit-daemon0-21swapper/221:58:272
280663992220,1cyclictest3056-21PK-Backend23:50:233
280663992220,1cyclictest0-21swapper/323:58:563
280663992220,1cyclictest0-21swapper/321:37:143
280663992220,1cyclictest0-21swapper/320:55:433
280663992215,5cyclictest322083-21/usr/sbin/munin21:05:163
280660992220,1cyclictest0-21swapper/223:41:372
280660992220,1cyclictest0-21swapper/223:19:062
280660992220,1cyclictest0-21swapper/223:19:052
280660992220,1cyclictest0-21swapper/221:33:062
28066099220,21cyclictest0-21swapper/222:30:112
28065799229,11cyclictest393488-21df00:30:141
280657992220,1cyclictest3056-21PK-Backend00:19:061
280657992220,1cyclictest0-21swapper/123:43:381
280657992220,1cyclictest0-21swapper/123:26:341
280657992219,2cyclictest3056-21PK-Backend21:02:511
280657992213,7cyclictest347259-21cron22:19:591
280653992216,5cyclictest300106-21cron20:05:000
139099220,3rtkit-daemon0-21swapper/322:16:553
139099220,16rtkit-daemon1317-21systemd20:58:352
139099220,16rtkit-daemon0-21swapper/222:03:342
139099220,15rtkit-daemon0-21swapper/221:12:082
139099220,14rtkit-daemon0-21swapper/322:06:163
280663992119,1cyclictest3056-21PK-Backend23:24:143
280663992119,1cyclictest3056-21PK-Backend23:00:563
280663992119,1cyclictest0-21swapper/322:14:393
280663992119,1cyclictest0-21swapper/321:15:243
280663992119,1cyclictest0-21swapper/320:41:383
280663992119,1cyclictest0-21swapper/320:02:433
280663992119,1cyclictest0-21swapper/319:50:553
280663992119,1cyclictest0-21swapper/319:33:163
280663992117,3cyclictest0-21swapper/321:59:513
280663992111,8cyclictest330181-21apt21:30:113
28066399210,20cyclictest3056-21PK-Backend21:40:533
28066399210,20cyclictest0-21swapper/319:48:253
280660992119,1cyclictest0-21swapper/223:22:572
280660992119,1cyclictest0-21swapper/222:50:402
280660992119,1cyclictest0-21swapper/222:44:522
280660992119,1cyclictest0-21swapper/222:23:162
280660992119,1cyclictest0-21swapper/221:53:282
280660992119,1cyclictest0-21swapper/221:02:522
280660992119,1cyclictest0-21swapper/220:52:452
280660992119,1cyclictest0-21swapper/220:45:412
280660992119,1cyclictest0-21swapper/220:39:462
280660992118,2cyclictest0-21swapper/219:20:182
28066099211,19cyclictest0-21swapper/223:52:172
28066099211,19cyclictest0-21swapper/221:16:042
28066099210,6cyclictest305658-21apt20:20:112
28066099210,20cyclictest34-21ksoftirqd/219:10:032
28066099210,20cyclictest0-21swapper/222:28:152
28066099210,20cyclictest0-21swapper/221:39:492
28066099210,20cyclictest0-21swapper/219:58:442
28066099210,19cyclictest3056-21PK-Backend23:55:012
280657992120,1cyclictest0-21swapper/120:30:331
280657992119,1cyclictest3056-21PK-Backend21:57:191
280657992119,1cyclictest3056-21PK-Backend20:36:491
280657992119,1cyclictest3056-21PK-Backend20:16:131
280657992119,1cyclictest3056-21PK-Backend19:45:301
280657992119,1cyclictest3056-21PK-Backend00:36:451
280657992119,1cyclictest0-21swapper/123:17:091
280657992119,1cyclictest0-21swapper/123:17:091
280657992119,1cyclictest0-21swapper/123:03:501
280657992119,1cyclictest0-21swapper/121:42:111
280657992118,2cyclictest3056-21PK-Backend21:09:201
280657992118,2cyclictest3056-21PK-Backend19:36:321
280657992118,2cyclictest3056-21PK-Backend00:22:241
280657992118,2cyclictest3056-21PK-Backend00:00:071
280657992112,7cyclictest303609-21cron20:15:001
28065799210,20cyclictest3056-21PK-Backend22:07:391
28065799210,20cyclictest0-21swapper/120:26:551
28065799210,19cyclictest3056-21PK-Backend22:32:141
28065799210,19cyclictest3056-21PK-Backend22:10:431
28065799210,19cyclictest3056-21PK-Backend19:53:211
28065799210,19cyclictest3056-21PK-Backend19:42:271
28065399213,10cyclictest295327-21cpuspeed_turbos19:50:120
280653992119,1cyclictest0-21swapper/023:47:440
280653992113,7cyclictest392744-21sshd00:28:440
139099210,15rtkit-daemon0-21swapper/320:18:363
139099210,14rtkit-daemon0-21swapper/322:44:143
139099210,14rtkit-daemon0-21swapper/322:29:043
139099210,14rtkit-daemon0-21swapper/222:56:542
139099210,14rtkit-daemon0-21swapper/222:13:022
139099210,14rtkit-daemon0-21swapper/220:02:062
28066399205,13cyclictest289971-21acpi19:35:103
280663992018,1cyclictest3056-21PK-Backend23:41:513
280663992018,1cyclictest3056-21PK-Backend23:16:433
280663992018,1cyclictest3056-21PK-Backend23:16:433
280663992018,1cyclictest0-21swapper/321:11:123
280663992018,1cyclictest0-21swapper/321:00:303
280663992018,1cyclictest0-21swapper/319:41:083
280663992018,1cyclictest0-21swapper/319:25:053
280663992018,1cyclictest0-21swapper/300:00:173
280663992015,3cyclictest336852-21sh21:50:003
280663992013,5cyclictest306253-21cat20:20:163
280663992012,6cyclictest436-20systemd-journal20:15:013
28066399200,19cyclictest3056-21PK-Backend00:31:193
28066399200,19cyclictest0-21swapper/322:51:153
28066399200,19cyclictest0-21swapper/322:47:233
28066399200,19cyclictest0-21swapper/300:19:303
28066399200,19cyclictest0-21swapper/300:06:523
280660992018,1cyclictest0-21swapper/200:28:282
280660992018,1cyclictest0-21swapper/200:15:502
28066099201,5cyclictest0-21swapper/200:20:132
28066099200,19cyclictest0-21swapper/223:32:512
28066099200,19cyclictest0-21swapper/223:11:222
28066099200,19cyclictest0-21swapper/222:07:402
28066099200,19cyclictest0-21swapper/219:50:532
28066099200,19cyclictest0-21swapper/219:42:482
28066099200,19cyclictest0-21swapper/200:07:052
28065799206,4cyclictest251rcuc/123:40:001
280657992018,1cyclictest3056-21PK-Backend22:53:021
280657992018,1cyclictest3056-21PK-Backend22:04:011
280657992018,1cyclictest3056-21PK-Backend21:37:581
280657992018,1cyclictest3056-21PK-Backend21:29:001
280657992018,1cyclictest3056-21PK-Backend20:21:331
280657992018,1cyclictest3056-21PK-Backend19:12:591
280657992018,1cyclictest3056-21PK-Backend00:07:171
280657992018,1cyclictest0-21swapper/123:21:351
280657992018,1cyclictest0-21swapper/122:25:311
280657992017,2cyclictest3056-21PK-Backend20:54:391
280657992012,6cyclictest364032-21grep23:05:181
28065799200,1cyclictest3056-21PK-Backend20:41:201
28065799200,19cyclictest3056-21PK-Backend21:45:491
28065799200,19cyclictest0-21swapper/122:57:291
280653992018,1cyclictest0-21swapper/000:07:100
280653992016,3cyclictest335124-21idleruntime-cro21:45:000
280653992015,3cyclictest324712-21ls21:15:000
280653992013,6cyclictest391155-21pluginstate00:25:010
280653992013,6cyclictest366544-21seq23:14:440
280653992012,6cyclictest367591-21ntp_states23:15:220
280653992012,6cyclictest367591-21ntp_states23:15:220
28065399200,1cyclictest0-21swapper/020:23:430
28065399200,19cyclictest0-21swapper/021:52:250
139099200,14rtkit-daemon0-21swapper/320:39:013
139099200,14rtkit-daemon0-21swapper/319:57:513
139099200,14rtkit-daemon0-21swapper/319:18:453
139099200,14rtkit-daemon0-21swapper/219:27:442
139099200,13rtkit-daemon3056-21PK-Backend23:39:163
139099200,13rtkit-daemon0-21swapper/322:01:163
139099200,13rtkit-daemon0-21swapper/319:23:083
3305932190,2sleep13056-21PK-Backend21:30:161
280663991917,1cyclictest3056-21PK-Backend23:31:253
280663991914,3cyclictest281908-21users19:10:223
28066399190,7cyclictest329055-21missed_timers21:25:173
28066399190,1cyclictest0-21swapper/320:50:233
28066399190,18cyclictest3056-21PK-Backend23:12:173
28066399190,18cyclictest0-21swapper/322:37:103
28066399190,16cyclictest386933-21ntp_states00:10:183
280660991917,1cyclictest0-21swapper/220:25:412
280660991917,1cyclictest0-21swapper/200:33:082
28066099191,6cyclictest34-21ksoftirqd/223:35:042
28066099191,2cyclictest0-21swapper/200:15:002
28066099190,1cyclictest0-21swapper/223:04:112
28066099190,1cyclictest0-21swapper/222:46:482
28066099190,1cyclictest0-21swapper/221:26:582
28066099190,1cyclictest0-21swapper/219:30:112
28066099190,18cyclictest34-21ksoftirqd/220:16:572
28066099190,18cyclictest0-21swapper/222:18:502
28066099190,18cyclictest0-21swapper/221:47:542
28066099190,18cyclictest0-21swapper/200:36:252
280657991917,1cyclictest3056-21PK-Backend19:30:031
280657991917,1cyclictest0-21swapper/123:51:351
280657991917,1cyclictest0-21swapper/100:27:381
280657991916,2cyclictest3056-21PK-Backend21:24:141
280657991916,2cyclictest3056-21PK-Backend21:24:131
280657991916,2cyclictest3056-21PK-Backend21:19:261
28065799190,1cyclictest3056-21PK-Backend22:44:091
28065799190,1cyclictest3056-21PK-Backend00:10:361
28065399198,2cyclictest141rcu_preempt19:40:000
280653991917,1cyclictest0-21swapper/023:31:080
280653991917,1cyclictest0-21swapper/022:34:030
280653991917,1cyclictest0-21swapper/020:09:520
280653991912,6cyclictest395580-21awk00:35:200
280653991912,5cyclictest379622-21entropy23:50:170
280653991912,5cyclictest346288-21sed22:15:170
280653991912,5cyclictest308438-21cat20:25:210
280653991912,5cyclictest284052-21sed19:15:230
28065399190,8cyclictest436-20systemd-journal22:24:590
28065399190,18cyclictest0-21swapper/020:30:190
139099190,13rtkit-daemon34-21ksoftirqd/220:14:322
139099190,13rtkit-daemon0-21swapper/219:18:252
280663991816,1cyclictest3056-21PK-Backend23:26:113
280663991816,1cyclictest3056-21PK-Backend23:07:183
28066399181,4cyclictest390138-21irqstats00:20:193
28066399181,15cyclictest395230-21df_inode00:35:143
28066399180,16cyclictest314999-21needreboot20:45:193
28066399180,15cyclictest359920-21apt22:55:113
280660991816,1cyclictest0-21swapper/219:39:092
280660991813,3cyclictest300391-21cpu20:05:122
280657991815,2cyclictest3056-21PK-Backend19:55:181
280653991816,1cyclictest0-21swapper/020:55:540
280653991815,2cyclictest3056-21PK-Backend22:40:180
280653991814,3cyclictest286700-21cpuspeed_turbos19:25:120
280653991812,5cyclictest297063-21cpuspeed_turbos19:55:130
280653991811,5cyclictest371184-21cat23:25:180
280653991810,6cyclictest393121-21awk00:30:120
28065399180,1cyclictest0-21swapper/020:54:460
3914432170,2chrt0-21swapper/300:25:133
28066399172,12cyclictest326719-21apt21:20:153
28066399172,12cyclictest326719-21apt21:20:153
28066099173,12cyclictest0-21swapper/222:35:112
280660991712,4cyclictest309566-21awk20:30:152
28065799172,11cyclictest287998-21munin-plugin-st19:30:001
280657991714,2cyclictest3056-21PK-Backend21:53:071
280657991710,5cyclictest381156-21tr23:55:131
280657991710,2cyclictest26-21ksoftirqd/123:30:151
28065399179,6cyclictest376641-21python323:40:210
28065399177,2cyclictest141rcu_preempt21:25:000
28065399177,2cyclictest141rcu_preempt21:25:000
280653991712,4cyclictest13-21ksoftirqd/021:05:000
280653991712,3cyclictest369725-21swap23:20:240
280653991711,5cyclictest345511-21cron22:14:590
280653991711,5cyclictest314172-21grep20:45:010
280653991710,6cyclictest364413-21sed23:05:240
280657991614,1cyclictest3056-21PK-Backend22:22:271
280657991611,2cyclictest26-21ksoftirqd/121:10:201
28065799161,11cyclictest357930-21munin-run22:50:001
28065399169,6cyclictest357919-21cron22:50:000
28065399169,5cyclictest374225-21cut23:35:110
28065399163,2cyclictest141rcu_preempt21:15:090
280653991614,1cyclictest0-21swapper/019:43:490
280653991612,3cyclictest13-21ksoftirqd/021:30:000
280653991611,4cyclictest341235-21needreboot22:00:180
280653991610,5cyclictest360897-21grep22:55:210
280653991610,5cyclictest1-21systemd19:24:590
28065399160,14cyclictest289736-21turbostat19:34:590
280657991511,2cyclictest26-21ksoftirqd/120:06:121
28065399158,5cyclictest332958-21sed21:35:220
28065399158,5cyclictest280829-21awk19:10:110
28065399157,7cyclictest883-21dbus-daemon21:48:260
28065399157,7cyclictest339025-21tr21:55:120
28065399154,2cyclictest141rcu_preempt21:30:170
28065399154,2cyclictest141rcu_preempt20:50:010
28065399154,2cyclictest141rcu_preempt20:15:020
28065399153,2cyclictest141rcu_preempt19:45:110
28065399153,2cyclictest141rcu_preempt00:10:150
28065399153,2cyclictest141rcu_preempt00:00:120
28065399152,2cyclictest141rcu_preempt22:50:140
280653991511,3cyclictest322966-21cron21:10:010
280653991510,4cyclictest353335-21expr22:35:130
280653991510,3cyclictest304538-21needreboot20:15:170
28065799149,3cyclictest3157162sleep120:49:181
280657991410,2cyclictest26-21ksoftirqd/119:24:591
28065799140,6cyclictest0-21swapper/121:00:011
28065399141,2cyclictest141rcu_preempt22:30:000
280653991411,2cyclictest382448-21latency_hist00:00:020
28065399140,13cyclictest0-21swapper/020:39:390
280663991311,1cyclictest3056-21PK-Backend20:30:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional