You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Apr 06, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225771521110,4sleep20-21swapper/207:20:182
230991521020,3sleep00-21swapper/009:50:160
23005812930,3sleep2331rcuc/209:25:002
225163026944,18sleep20-21swapper/207:05:182
225243026539,9sleep30-21swapper/307:06:353
139099650,55rtkit-daemon0-21swapper/007:09:340
225173526445,13sleep10-21swapper/107:05:211
22975922460,6sleep30-21swapper/309:15:143
2252852992912,9cyclictest34-21ksoftirqd/212:10:012
23509642260,9sleep234-21ksoftirqd/211:46:392
2252852992622,3cyclictest331rcuc/212:21:352
2252852992622,3cyclictest331rcuc/212:21:342
2252852992622,3cyclictest331rcuc/208:46:462
2252852992622,3cyclictest331rcuc/208:19:152
2252845992612,12cyclictest2358233-21unin-run12:10:010
139099260,19rtkit-daemon0-21swapper/210:15:302
2252852992522,2cyclictest331rcuc/211:28:582
2252852992522,2cyclictest331rcuc/211:03:192
2252852992522,2cyclictest331rcuc/209:00:302
2252852992521,3cyclictest331rcuc/212:28:482
2252852992521,3cyclictest331rcuc/211:07:202
2252852992521,3cyclictest331rcuc/209:54:472
2252852992521,3cyclictest331rcuc/209:48:172
2252852992521,3cyclictest331rcuc/209:07:152
2252852992521,3cyclictest331rcuc/208:42:292
2252852992521,3cyclictest331rcuc/208:28:502
2252852992521,3cyclictest331rcuc/208:28:492
2252845992511,12cyclictest2302115-21cron09:30:000
2252845992511,12cyclictest2302115-21cron09:30:000
2252852992421,2cyclictest331rcuc/211:30:582
2252852992421,2cyclictest331rcuc/211:10:502
2252852992421,2cyclictest331rcuc/210:37:242
2252852992421,2cyclictest331rcuc/208:59:362
2252852992421,2cyclictest331rcuc/208:10:252
2252852992421,2cyclictest331rcuc/207:43:152
2252852992421,2cyclictest331rcuc/207:26:262
2252852992421,2cyclictest331rcuc/207:18:392
2252852992421,2cyclictest331rcuc/207:13:152
2252852992420,3cyclictest331rcuc/212:10:562
2252852992420,3cyclictest331rcuc/211:44:102
2252852992420,3cyclictest331rcuc/210:01:322
2252852992420,3cyclictest331rcuc/208:34:152
2252852992420,3cyclictest331rcuc/208:34:142
2252852992420,3cyclictest331rcuc/207:48:322
2252852992420,3cyclictest331rcuc/207:39:582
2252845992419,4cyclictest13-21ksoftirqd/008:56:040
22884422230,4chrt0-21swapper/308:50:003
2252856992313,8cyclictest2312981-21cut10:00:133
225285299236,7cyclictest34-21ksoftirqd/210:20:122
225285299234,8cyclictest34-21ksoftirqd/212:30:092
2252852992320,2cyclictest331rcuc/212:04:102
2252852992320,2cyclictest331rcuc/211:21:482
2252852992320,2cyclictest331rcuc/211:15:472
2252852992320,2cyclictest331rcuc/210:55:462
2252852992320,2cyclictest331rcuc/210:47:042
2252852992320,2cyclictest331rcuc/210:41:262
2252852992320,2cyclictest331rcuc/210:08:492
2252852992320,2cyclictest331rcuc/209:27:562
2252852992320,2cyclictest331rcuc/209:27:562
2252852992320,2cyclictest331rcuc/209:14:052
2252852992319,3cyclictest331rcuc/211:59:012
2252852992319,3cyclictest331rcuc/209:43:352
2252852992319,3cyclictest331rcuc/209:36:552
2252852992319,3cyclictest331rcuc/208:52:232
2252852992319,3cyclictest331rcuc/207:53:532
225285299230,5cyclictest2331210-21processes10:50:202
2252845992321,1cyclictest0-21swapper/009:44:040
2252845992318,3cyclictest1788620-21WebKitWebProces10:42:030
2252856992220,1cyclictest0-21swapper/310:58:063
2252856992220,1cyclictest0-21swapper/310:29:193
2252856992220,1cyclictest0-21swapper/310:29:193
2252852992219,2cyclictest331rcuc/208:24:532
2252852992219,2cyclictest331rcuc/208:08:402
2252852992219,2cyclictest331rcuc/208:01:512
2252852992218,3cyclictest331rcuc/210:31:272
2252852992218,3cyclictest331rcuc/209:15:372
2252845992220,1cyclictest0-21swapper/011:39:290
2252845992219,2cyclictest3056-21PK-Backend12:27:210
2252845992214,2cyclictest13-21ksoftirqd/007:55:200
22742122210,4sleep13056-21PK-Backend08:10:011
2252856992119,1cyclictest0-21swapper/312:32:433
2252856992119,1cyclictest0-21swapper/310:52:123
2252856992119,1cyclictest0-21swapper/310:43:133
2252856992119,1cyclictest0-21swapper/310:37:183
2252856992119,1cyclictest0-21swapper/310:24:273
2252856992119,1cyclictest0-21swapper/309:12:483
2252856992119,1cyclictest0-21swapper/307:55:423
2252856992118,2cyclictest0-21swapper/308:20:443
2252856992115,4cyclictest2275248-21python308:10:203
2252856992113,6cyclictest436-20systemd-journal11:05:013
2252856992113,6cyclictest2304505-21diskstats09:35:143
2252856992113,6cyclictest2267172-21cron07:50:003
225285699211,17cyclictest2282441-21python308:30:203
225285699211,17cyclictest2282441-21python308:30:203
225285699210,20cyclictest3056-21PK-Backend10:16:293
225285699210,20cyclictest0-21swapper/309:29:183
225285699210,20cyclictest0-21swapper/309:29:183
225285699210,20cyclictest0-21swapper/309:03:153
225285699210,20cyclictest0-21swapper/308:55:453
225285699210,20cyclictest0-21swapper/308:36:593
2252852992119,1cyclictest0-21swapper/209:31:532
2252852992119,1cyclictest0-21swapper/209:31:532
2252852992119,1cyclictest0-21swapper/208:36:032
2252852992119,1cyclictest0-21swapper/207:30:052
2252852992118,2cyclictest331rcuc/209:55:512
2252852992117,3cyclictest331rcuc/207:55:052
2252849992119,1cyclictest3056-21PK-Backend11:43:001
2252849992119,1cyclictest0-21swapper/108:41:041
225284999210,19cyclictest3056-21PK-Backend12:00:181
2252845992119,1cyclictest3056-21PK-Backend07:40:410
2252845992119,1cyclictest0-21swapper/011:31:590
2252845992119,1cyclictest0-21swapper/011:28:060
2252845992119,1cyclictest0-21swapper/010:49:000
2252845992119,1cyclictest0-21swapper/010:11:140
2252845992119,1cyclictest0-21swapper/010:09:120
2252845992119,1cyclictest0-21swapper/009:57:070
2252845992119,1cyclictest0-21swapper/009:33:140
2252845992119,1cyclictest0-21swapper/009:33:140
2252845992119,1cyclictest0-21swapper/009:19:370
2252845992119,1cyclictest0-21swapper/009:08:010
2252845992119,1cyclictest0-21swapper/008:32:120
2252845992119,1cyclictest0-21swapper/008:32:120
2252845992119,1cyclictest0-21swapper/007:24:390
2252845992118,2cyclictest0-21swapper/007:46:420
225284599210,20cyclictest0-21swapper/010:21:140
225284599210,1cyclictest0-21swapper/008:16:230
23304312200,2sleep13056-21PK-Backend10:50:131
2252856992018,1cyclictest0-21swapper/312:04:243
2252856992018,1cyclictest0-21swapper/311:46:203
2252856992018,1cyclictest0-21swapper/311:28:143
2252856992018,1cyclictest0-21swapper/311:21:313
2252856992018,1cyclictest0-21swapper/310:31:233
2252856992018,1cyclictest0-21swapper/310:05:283
2252856992018,1cyclictest0-21swapper/309:59:183
2252856992018,1cyclictest0-21swapper/309:46:153
2252856992018,1cyclictest0-21swapper/309:43:103
2252856992018,1cyclictest0-21swapper/308:08:543
2252856992018,1cyclictest0-21swapper/308:01:233
2252856992011,7cyclictest2279685-21sort08:25:123
2252856992011,7cyclictest2279685-21sort08:25:113
225285699200,1cyclictest0-21swapper/312:12:423
225285699200,1cyclictest0-21swapper/311:50:583
225285699200,1cyclictest0-21swapper/309:08:573
225285699200,1cyclictest0-21swapper/307:28:053
225285699200,19cyclictest0-21swapper/312:09:043
225285699200,19cyclictest0-21swapper/310:49:083
225285699200,19cyclictest0-21swapper/309:54:123
225285699200,19cyclictest0-21swapper/309:31:213
225285699200,19cyclictest0-21swapper/309:31:203
225285699200,19cyclictest0-21swapper/308:53:423
225285699200,19cyclictest0-21swapper/308:40:503
225285699200,19cyclictest0-21swapper/307:54:553
225285299204,6cyclictest34-21ksoftirqd/210:27:512
225285299204,6cyclictest34-21ksoftirqd/210:27:512
225285299202,5cyclictest34-21ksoftirqd/212:15:222
2252852992016,3cyclictest34-21ksoftirqd/212:40:012
2252852992016,3cyclictest331rcuc/211:51:202
2252849992018,1cyclictest3056-21PK-Backend09:41:001
2252849992018,1cyclictest3056-21PK-Backend07:47:501
2252849992017,2cyclictest3056-21PK-Backend10:30:211
2252849992012,6cyclictest2319259-21ls10:15:351
2252845992018,1cyclictest0-21swapper/012:21:540
2252845992018,1cyclictest0-21swapper/012:21:530
2252845992018,1cyclictest0-21swapper/011:58:350
2252845992018,1cyclictest0-21swapper/011:50:030
2252845992018,1cyclictest0-21swapper/011:12:390
2252845992018,1cyclictest0-21swapper/010:19:120
2252845992018,1cyclictest0-21swapper/010:00:130
2252845992018,1cyclictest0-21swapper/009:46:060
2252845992018,1cyclictest0-21swapper/008:21:360
2252845992018,1cyclictest0-21swapper/007:52:090
2252845992015,3cyclictest2254496-21latency_hist07:15:000
2252845992013,5cyclictest2331928-21sed10:55:000
225284599200,1cyclictest3056-21PK-Backend10:33:040
225284599200,19cyclictest0-21swapper/010:35:070
225284599200,19cyclictest0-21swapper/009:38:090
225284599200,19cyclictest0-21swapper/009:02:200
225284599200,19cyclictest0-21swapper/008:51:450
225284599200,19cyclictest0-21swapper/008:43:460
225284599200,19cyclictest0-21swapper/008:36:040
225284599200,19cyclictest0-21swapper/007:18:030
139099200,3rtkit-daemon1389-21rtkit-daemon09:20:581
225285699192,12cyclictest2360464-21apt12:15:123
2252856991917,1cyclictest0-21swapper/312:38:113
2252856991917,1cyclictest0-21swapper/312:29:053
2252856991917,1cyclictest0-21swapper/311:40:383
2252856991917,1cyclictest0-21swapper/308:18:543
2252856991917,1cyclictest0-21swapper/307:19:533
2252856991917,1cyclictest0-21swapper/307:14:533
2252856991914,3cyclictest2263058-21python307:35:203
2252856991911,6cyclictest2353374-21cat11:55:133
225285699190,1cyclictest3056-21PK-Backend11:33:563
225285699190,1cyclictest3056-21PK-Backend09:24:243
225285699190,1cyclictest0-21swapper/311:19:293
225285699190,1cyclictest0-21swapper/307:21:493
2252852991915,3cyclictest2316650-21grep10:10:122
225284999190,5cyclictest3056-21PK-Backend08:03:431
2252845991917,1cyclictest0-21swapper/012:31:000
2252845991917,1cyclictest0-21swapper/012:02:270
2252845991917,1cyclictest0-21swapper/011:49:020
2252845991917,1cyclictest0-21swapper/011:21:230
2252845991917,1cyclictest0-21swapper/011:17:310
2252845991917,1cyclictest0-21swapper/009:14:420
2252845991917,1cyclictest0-21swapper/008:09:000
2252845991917,1cyclictest0-21swapper/007:26:480
225284599190,1cyclictest0-21swapper/011:06:440
225284599190,1cyclictest0-21swapper/011:01:510
225284599190,1cyclictest0-21swapper/009:20:380
225284599190,1cyclictest0-21swapper/008:02:510
225284599190,18cyclictest0-21swapper/012:39:040
225284599190,18cyclictest0-21swapper/008:27:180
225284599190,18cyclictest0-21swapper/008:27:170
225284599190,18cyclictest0-21swapper/008:10:350
2252856991816,1cyclictest0-21swapper/311:08:553
225285699181,16cyclictest2264047-21sort07:40:123
2252856991811,5cyclictest2346704-21ntp_kernel_err11:35:173
225285699181,15cyclictest2337304-21sshd11:10:093
225285699181,13cyclictest2260466-21apt07:30:103
2252852991814,3cyclictest2346648-21grep11:35:152
225284999188,9cyclictest3056-21PK-Backend07:29:591
225284999188,2cyclictest141rcu_preempt11:35:211
2252849991816,1cyclictest3056-21PK-Backend10:39:541
2252849991812,5cyclictest2317582-21cat10:10:211
2252845991816,1cyclictest0-21swapper/012:16:250
2252845991816,1cyclictest0-21swapper/011:43:210
2252845991816,1cyclictest0-21swapper/008:46:520
2252856991715,1cyclictest0-21swapper/312:21:003
2252856991715,1cyclictest0-21swapper/312:21:003
2252856991715,1cyclictest0-21swapper/310:10:353
225284999179,6cyclictest883-21dbus-daemon10:05:011
2252849991713,2cyclictest2365424-21latency_hist12:30:001
2252849991713,2cyclictest2315999-21latency_hist10:10:011
2252849991711,5cyclictest2303263-21smartctl09:30:201
2252849991711,5cyclictest2303263-21smartctl09:30:201
2252849991710,5cyclictest436-20systemd-journal08:40:001
2252845991715,1cyclictest0-21swapper/010:25:200
2252845991715,1cyclictest0-21swapper/010:25:190
2252845991711,5cyclictest2262673-21awk07:35:160
2252849991613,2cyclictest3056-21PK-Backend10:57:521
2252849991612,2cyclictest2345759-21sh11:35:001
225284999160,15cyclictest3056-21PK-Backend11:09:011
2252845991610,4cyclictest2360178-21cron12:14:590
139099160,13rtkit-daemon3056-21PK-Backend09:35:201
23505302150,4sleep13056-21PK-Backend11:45:211
22768422151,5sleep126-21ksoftirqd/108:15:181
22579322150,4chrt3056-21PK-Backend07:20:201
225284999159,5cyclictest2353968-21awk11:55:191
225284999159,4cyclictest2301461-21ps09:25:201
225284999159,4cyclictest2301461-21ps09:25:201
225284999153,10cyclictest2353036-21grep11:55:011
2252849991513,1cyclictest3056-21PK-Backend12:32:211
2252849991513,1cyclictest3056-21PK-Backend12:23:161
2252849991513,1cyclictest3056-21PK-Backend12:23:161
2252849991513,1cyclictest3056-21PK-Backend12:05:511
2252849991513,1cyclictest3056-21PK-Backend09:07:191
2252849991513,1cyclictest3056-21PK-Backend08:58:001
2252849991513,1cyclictest3056-21PK-Backend08:51:381
2252849991511,3cyclictest3056-21PK-Backend10:46:111
2252849991511,3cyclictest3056-21PK-Backend07:37:531
225284999151,13cyclictest2312542-21munin-run10:00:011
225284999150,14cyclictest3056-21PK-Backend11:26:311
225284999150,14cyclictest3056-21PK-Backend07:16:551
225284599156,7cyclictest1983-21gdbus10:58:030
2252849991412,1cyclictest3056-21PK-Backend08:12:301
2252849991410,3cyclictest3056-21PK-Backend12:15:421
2252849991410,3cyclictest3056-21PK-Backend08:24:571
2252849991410,3cyclictest3056-21PK-Backend07:56:501
225284999140,6cyclictest3056-21PK-Backend10:40:151
225284999140,6cyclictest3056-21PK-Backend09:20:011
225284999140,6cyclictest3056-21PK-Backend08:28:091
225284999140,6cyclictest3056-21PK-Backend08:28:091
225284999140,1cyclictest3056-21PK-Backend11:00:151
225284999140,1cyclictest3056-21PK-Backend09:45:451
225284999140,1cyclictest3056-21PK-Backend09:03:201
225284999140,1cyclictest3056-21PK-Backend08:34:281
225284999140,1cyclictest3056-21PK-Backend08:34:271
225284999140,13cyclictest3056-21PK-Backend12:13:211
225284999140,13cyclictest3056-21PK-Backend11:22:321
2252845991412,1cyclictest0-21swapper/007:32:420
139099140,11rtkit-daemon945-21thermald07:10:031
225284999139,3cyclictest3056-21PK-Backend11:10:531
225284999139,3cyclictest3056-21PK-Backend09:50:301
225284999139,3cyclictest3056-21PK-Backend08:45:421
225284999139,3cyclictest3056-21PK-Backend07:54:171
225284999139,3cyclictest3056-21PK-Backend07:30:031
225284999139,3cyclictest2264570-21missed_timers07:40:171
225284999133,2cyclictest141rcu_preempt10:25:201
225284999133,2cyclictest141rcu_preempt10:25:201
225284999130,1cyclictest3056-21PK-Backend10:20:331
225284999128,3cyclictest3056-21PK-Backend11:18:551
225284999120,6cyclictest3056-21PK-Backend09:10:171
225284999110,2cyclictest3056-21PK-Backend12:35:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional