You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 20:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat Aug 01, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157496121350,2sleep00-21swapper/012:30:130
147115221150,2sleep10-21swapper/107:35:211
148797921120,15sleep10-21swapper/108:25:131
145993021010,4sleep00-21swapper/007:05:190
139099810,45rtkit-daemon0-21swapper/107:06:391
146056427639,14sleep20-21swapper/207:07:042
146045526640,20sleep30-21swapper/307:05:403
139099510,3rtkit-daemon3056-21PK-Backend10:07:010
139099510,3rtkit-daemon0-21swapper/109:16:320
139099510,3rtkit-daemon0-21swapper/108:58:020
14739532500,4sleep21473954-21cpuspeed_turbos07:45:122
14739532500,4sleep21473954-21cpuspeed_turbos07:45:122
139099480,3rtkit-daemon0-21swapper/109:36:540
139099440,3rtkit-daemon0-21swapper/009:12:210
14850812430,4sleep33056-21PK-Backend08:15:213
1460917992610,14cyclictest1569259-21cron12:15:000
139099260,23rtkit-daemon978-21snmpd10:55:152
1460927992519,5cyclictest42-21ksoftirqd/308:40:003
139099250,4rtkit-daemon1389-21rtkit-daemon11:48:003
14860572240,3sleep03056-21PK-Backend08:20:120
1460920992415,7cyclictest436-20systemd-journal11:00:011
1460924992321,1cyclictest0-21swapper/207:30:222
1460920992318,3cyclictest1528361-21cron10:20:001
15603982220,4sleep13056-21PK-Backend11:50:001
1460927992220,1cyclictest3056-21PK-Backend10:22:343
1460927992220,1cyclictest3056-21PK-Backend09:22:383
1460927992219,2cyclictest3056-21PK-Backend07:31:463
1460927992218,3cyclictest1486314-21diskstats08:20:143
146092799220,20cyclictest3056-21PK-Backend11:35:213
146092799220,20cyclictest3056-21PK-Backend11:03:373
146092799220,20cyclictest3056-21PK-Backend10:32:483
1460924992220,1cyclictest0-21swapper/212:33:512
1460924992220,1cyclictest0-21swapper/210:14:402
1460924992220,1cyclictest0-21swapper/209:44:392
1460924992220,1cyclictest0-21swapper/208:51:132
1460924992220,1cyclictest0-21swapper/207:25:552
146092499220,21cyclictest0-21swapper/207:10:542
1460920992212,8cyclictest1547678-21apt-get11:15:001
146092099220,20cyclictest3056-21PK-Backend12:05:451
1460917992216,5cyclictest1523107-21perf10:05:000
1460917992215,5cyclictest13-21ksoftirqd/010:15:110
1460927992119,1cyclictest3056-21PK-Backend10:18:093
1460927992119,1cyclictest3056-21PK-Backend08:59:273
1460927992119,1cyclictest3056-21PK-Backend07:15:583
1460927992119,1cyclictest0-21swapper/312:21:103
1460927992119,1cyclictest0-21swapper/311:53:533
1460927992119,1cyclictest0-21swapper/309:55:373
146092799210,20cyclictest3056-21PK-Backend10:42:293
146092799210,20cyclictest0-21swapper/312:12:063
146092799210,20cyclictest0-21swapper/308:31:553
146092799210,20cyclictest0-21swapper/308:06:473
146092799210,19cyclictest3056-21PK-Backend09:14:083
146092799210,19cyclictest3056-21PK-Backend07:12:063
1460924992119,1cyclictest0-21swapper/212:02:142
1460924992119,1cyclictest0-21swapper/210:08:182
1460924992119,1cyclictest0-21swapper/209:58:512
1460924992119,1cyclictest0-21swapper/209:34:312
1460924992119,1cyclictest0-21swapper/208:26:462
1460924992119,1cyclictest0-21swapper/208:20:022
1460924992119,1cyclictest0-21swapper/208:19:142
1460924992119,1cyclictest0-21swapper/208:10:562
1460924992119,1cyclictest0-21swapper/207:42:512
146092499211,2cyclictest0-21swapper/212:35:132
146092499210,2cyclictest0-21swapper/210:40:012
146092499210,20cyclictest0-21swapper/211:08:342
146092499210,20cyclictest0-21swapper/211:04:422
146092499210,20cyclictest0-21swapper/210:33:262
146092499210,20cyclictest0-21swapper/209:53:512
146092499210,20cyclictest0-21swapper/209:16:552
146092499210,1cyclictest0-21swapper/212:27:022
1460920992117,2cyclictest3056-21PK-Backend08:33:191
1460920992113,6cyclictest1518567-21awk09:50:151
146092099210,20cyclictest0-21swapper/112:30:181
146092099210,20cyclictest0-21swapper/111:33:071
146092099210,20cyclictest0-21swapper/109:44:311
146092099210,1cyclictest0-21swapper/110:28:111
146092099210,19cyclictest3056-21PK-Backend11:41:251
146092099210,19cyclictest3056-21PK-Backend09:01:121
146092099210,19cyclictest3056-21PK-Backend07:55:411
1460917992113,6cyclictest1564705-21df12:00:130
146091799210,20cyclictest0-21swapper/010:45:180
146091799210,20cyclictest0-21swapper/007:26:450
14901352200,3chrt0-21swapper/208:30:212
1460927992018,1cyclictest3056-21PK-Backend09:52:333
1460927992018,1cyclictest3056-21PK-Backend09:38:473
1460927992018,1cyclictest3056-21PK-Backend07:45:393
1460927992018,1cyclictest3056-21PK-Backend07:45:383
1460927992018,1cyclictest0-21swapper/311:42:183
1460927992018,1cyclictest0-21swapper/310:55:333
1460927992018,1cyclictest0-21swapper/310:08:423
1460927992018,1cyclictest0-21swapper/307:42:073
1460927992016,2cyclictest3056-21PK-Backend11:20:343
1460927992015,4cyclictest1570489-21timerandwakeup12:15:223
146092799200,1cyclictest3056-21PK-Backend11:33:253
146092799200,19cyclictest3056-21PK-Backend12:26:583
146092799200,19cyclictest3056-21PK-Backend10:38:363
146092799200,19cyclictest3056-21PK-Backend10:28:563
146092799200,19cyclictest3056-21PK-Backend07:37:143
146092799200,19cyclictest3056-21PK-Backend07:23:563
146092799200,19cyclictest0-21swapper/312:01:033
146092799200,19cyclictest0-21swapper/308:41:563
146092799200,19cyclictest0-21swapper/308:26:553
146092799200,19cyclictest0-21swapper/308:01:403
146092799200,19cyclictest0-21swapper/307:55:593
146092799200,18cyclictest3056-21PK-Backend12:36:183
146092799200,18cyclictest3056-21PK-Backend11:18:043
146092799200,18cyclictest3056-21PK-Backend11:10:343
1460924992018,1cyclictest0-21swapper/212:21:492
1460924992018,1cyclictest0-21swapper/212:05:322
1460924992018,1cyclictest0-21swapper/211:20:442
1460924992018,1cyclictest0-21swapper/210:00:472
1460924992018,1cyclictest0-21swapper/208:46:462
1460924992018,1cyclictest0-21swapper/208:46:462
1460924992018,1cyclictest0-21swapper/208:41:112
1460924992018,1cyclictest0-21swapper/208:07:112
1460924992018,1cyclictest0-21swapper/207:56:582
1460924992018,1cyclictest0-21swapper/207:21:152
1460924992013,5cyclictest883-21dbus-daemon11:48:032
1460924992012,6cyclictest1502686-21df_inode09:05:132
146092499200,19cyclictest0-21swapper/211:43:292
146092499200,19cyclictest0-21swapper/211:18:492
146092499200,19cyclictest0-21swapper/210:53:552
146092499200,19cyclictest0-21swapper/210:20:292
146092499200,19cyclictest0-21swapper/209:21:342
146092499200,19cyclictest0-21swapper/208:36:112
146092499200,19cyclictest0-21swapper/208:03:272
146092099207,10cyclictest1475301-21unin-run07:50:011
146092099207,10cyclictest1475301-21unin-run07:50:001
1460920992017,2cyclictest3056-21PK-Backend08:38:211
1460920992017,2cyclictest3056-21PK-Backend08:24:071
146092099200,1cyclictest0-21swapper/109:57:571
146092099200,19cyclictest3056-21PK-Backend10:08:301
146092099200,19cyclictest3056-21PK-Backend09:08:411
146092099200,19cyclictest3056-21PK-Backend07:41:021
146092099200,19cyclictest0-21swapper/111:05:351
146092099200,19cyclictest0-21swapper/110:46:431
146092099200,19cyclictest0-21swapper/109:39:441
146092099200,19cyclictest0-21swapper/108:15:211
146092099200,19cyclictest0-21swapper/107:54:531
146092099200,18cyclictest3056-21PK-Backend12:17:551
146092099200,18cyclictest3056-21PK-Backend08:48:401
146092099200,18cyclictest3056-21PK-Backend08:48:401
146092099200,18cyclictest1569271-21apt12:15:001
1460917992018,1cyclictest0-21swapper/011:54:050
1460917992018,1cyclictest0-21swapper/010:29:500
1460917992018,1cyclictest0-21swapper/009:01:490
1460917992018,1cyclictest0-21swapper/008:16:340
1460917992018,1cyclictest0-21swapper/008:12:000
1460917992018,1cyclictest0-21swapper/007:57:130
1460917992014,5cyclictest13-21ksoftirqd/011:20:210
1460917992013,5cyclictest1540289-21sed10:50:230
1460917992013,5cyclictest1508624-21rt-features09:20:190
146091799200,1cyclictest0-21swapper/011:30:330
146091799200,1cyclictest0-21swapper/011:19:590
146091799200,1cyclictest0-21swapper/007:11:440
146091799200,19cyclictest3056-21PK-Backend11:40:000
146091799200,19cyclictest0-21swapper/012:21:090
146091799200,19cyclictest0-21swapper/009:55:430
146091799200,19cyclictest0-21swapper/008:05:180
139099200,3rtkit-daemon0-21swapper/107:33:021
139099200,17rtkit-daemon978-21snmpd11:14:422
146092799197,11cyclictest42-21ksoftirqd/308:46:423
146092799197,11cyclictest42-21ksoftirqd/308:46:413
1460927991917,1cyclictest3056-21PK-Backend11:05:333
1460927991917,1cyclictest3056-21PK-Backend09:44:433
1460927991917,1cyclictest3056-21PK-Backend07:27:073
1460927991917,1cyclictest0-21swapper/312:06:173
1460927991917,1cyclictest0-21swapper/310:01:113
1460927991914,3cyclictest2156-21gnome-shell09:07:093
1460927991912,5cyclictest1563071-21ntp_kernel_pll_11:55:203
1460927991912,5cyclictest1498002-21chrt08:51:023
146092799190,1cyclictest3056-21PK-Backend10:53:373
146092799190,1cyclictest3056-21PK-Backend07:52:293
146092799190,1cyclictest0-21swapper/309:01:573
146092799190,18cyclictest0-21swapper/310:11:133
1460924991917,1cyclictest0-21swapper/211:33:142
1460924991917,1cyclictest0-21swapper/211:25:442
1460924991917,1cyclictest0-21swapper/210:46:242
1460924991917,1cyclictest0-21swapper/209:47:432
1460924991917,1cyclictest0-21swapper/208:55:042
1460924991917,1cyclictest0-21swapper/207:51:162
1460924991915,3cyclictest978-21snmpd07:19:442
1460924991914,4cyclictest978-21snmpd10:27:082
1460924991912,5cyclictest1562770-21basename11:55:172
146092499190,1cyclictest0-21swapper/211:39:372
146092499190,1cyclictest0-21swapper/210:36:432
146092499190,18cyclictest0-21swapper/212:16:342
146092499190,18cyclictest0-21swapper/210:16:362
1460920991917,1cyclictest0-21swapper/111:39:291
1460920991917,1cyclictest0-21swapper/111:22:321
1460920991917,1cyclictest0-21swapper/111:16:241
1460920991917,1cyclictest0-21swapper/110:41:081
1460920991917,1cyclictest0-21swapper/110:23:451
1460920991917,1cyclictest0-21swapper/108:14:351
1460920991917,1cyclictest0-21swapper/107:27:561
1460920991917,1cyclictest0-21swapper/107:17:281
1460920991917,1cyclictest0-21swapper/107:12:091
1460920991913,4cyclictest1510962-21cron09:30:011
1460920991912,5cyclictest1506572-21sed09:15:171
1460920991912,5cyclictest1505750-21latency_hist09:15:011
1460920991912,4cyclictest1095-21runrttasks12:35:151
1460920991911,6cyclictest1543527-21awk11:00:201
1460920991911,6cyclictest1516495-21awk09:45:121
1460920991911,6cyclictest1497651-21which08:50:201
1460920991910,7cyclictest1574398-21sshd12:29:021
146092099190,1cyclictest0-21swapper/112:24:171
146092099190,1cyclictest0-21swapper/111:25:031
146092099190,1cyclictest0-21swapper/110:51:431
1460917991917,1cyclictest0-21swapper/012:37:050
1460917991917,1cyclictest0-21swapper/012:17:170
1460917991917,1cyclictest0-21swapper/009:06:160
1460917991917,1cyclictest0-21swapper/008:02:200
1460917991917,1cyclictest0-21swapper/007:32:460
1460917991917,1cyclictest0-21swapper/007:20:370
1460917991917,1cyclictest0-21swapper/007:18:340
1460917991912,6cyclictest1474950-21sshd07:46:030
1460917991912,6cyclictest1474950-21sshd07:46:020
1460917991912,5cyclictest1493955-21sed08:40:180
1460917991912,5cyclictest1476120-21load07:50:180
1460917991911,6cyclictest1552700-21sed11:25:210
146091799190,1cyclictest3056-21PK-Backend07:40:230
146091799190,1cyclictest0-21swapper/011:48:180
146091799190,1cyclictest0-21swapper/011:41:550
146091799190,1cyclictest0-21swapper/011:01:400
146091799190,1cyclictest0-21swapper/010:57:140
146091799190,1cyclictest0-21swapper/009:53:130
146091799190,18cyclictest0-21swapper/011:14:580
146091799190,18cyclictest0-21swapper/008:33:090
146092799180,16cyclictest1482525-21grep08:10:133
1460924991816,1cyclictest0-21swapper/211:53:092
1460924991816,1cyclictest0-21swapper/209:39:522
1460924991816,1cyclictest0-21swapper/209:28:572
1460924991816,1cyclictest0-21swapper/209:13:362
1460924991816,1cyclictest0-21swapper/209:04:302
1460924991810,6cyclictest1568474-21head12:10:192
1460920991816,1cyclictest3056-21PK-Backend10:10:261
1460920991816,1cyclictest0-21swapper/110:31:291
1460920991816,1cyclictest0-21swapper/108:58:421
1460920991816,1cyclictest0-21swapper/107:21:001
1460920991813,3cyclictest1095-21runrttasks10:00:131
1460920991811,5cyclictest1562696-21ls11:55:141
1460920991811,5cyclictest1512094-21gzip09:30:211
146092099181,13cyclictest1534701-21runrttasks10:35:251
146092099181,13cyclictest1508639-21chrt09:20:191
1460917991816,1cyclictest0-21swapper/009:45:560
1460917991816,1cyclictest0-21swapper/009:41:090
1460917991816,1cyclictest0-21swapper/009:25:480
1460917991812,5cyclictest1497266-21idleruntime08:50:160
1460917991811,5cyclictest1530259-21sed10:25:010
146091799180,1cyclictest0-21swapper/012:07:370
1460927991715,1cyclictest3056-21PK-Backend12:33:003
1460927991715,1cyclictest3056-21PK-Backend09:48:553
1460920991715,1cyclictest3056-21PK-Backend08:03:321
1460917991715,1cyclictest0-21swapper/010:35:050
1460917991715,1cyclictest0-21swapper/008:46:490
1460917991715,1cyclictest0-21swapper/008:46:480
146091799170,16cyclictest1489149-21awk08:30:000
1460927991611,3cyclictest1510982-21turbostat09:30:003
1460924991614,1cyclictest0-21swapper/207:39:212
146092099164,7cyclictest1563806-21apt-get12:00:081
1460920991613,2cyclictest3056-21PK-Backend08:08:401
1460917991614,1cyclictest0-21swapper/011:59:530
1460917991614,1cyclictest0-21swapper/011:08:030
1460917991614,1cyclictest0-21swapper/010:31:120
1460917991610,5cyclictest1512145-21sed09:30:220
1460917991610,4cyclictest1536564-21cat10:40:230
15611582150,3sleep13056-21PK-Backend11:50:161
1460927991513,1cyclictest3056-21PK-Backend11:26:423
1460927991512,2cyclictest3056-21PK-Backend10:47:283
1460927991512,2cyclictest1506020-21/usr/sbin/munin09:15:163
1460920991512,2cyclictest3056-21PK-Backend08:41:581
146091799158,5cyclictest1573278-21cat12:25:140
146091799157,6cyclictest436-20systemd-journal07:35:040
146091799157,5cyclictest1493179-21latency_hist08:40:000
146091799146,6cyclictest1526556-21cron10:15:000
146092799128,3cyclictest3056-21PK-Backend09:30:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional