You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 09:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Mon Apr 20, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
163729521060,4sleep20-21swapper/223:35:192
154259527940,13sleep30-21swapper/319:08:033
154128327946,23sleep10-21swapper/119:05:111
154210027646,21sleep20-21swapper/219:05:252
154126727243,20sleep00-21swapper/019:05:060
16472492510,4sleep03056-21PK-Backend00:05:130
15859892490,3sleep00-21swapper/021:10:170
16463262470,2sleep20-21swapper/200:00:222
15884082440,2sleep10-21swapper/121:16:361
1542906992916,3cyclictest26-21ksoftirqd/123:18:331
1542906992815,3cyclictest26-21ksoftirqd/120:47:041
1542906992611,4cyclictest26-21ksoftirqd/122:32:261
154290699260,6cyclictest26-21ksoftirqd/123:50:001
16472222250,11sleep342-21ksoftirqd/300:05:123
1542914992516,3cyclictest42-21ksoftirqd/323:30:013
154290699251,9cyclictest26-21ksoftirqd/122:50:001
1542906992510,4cyclictest26-21ksoftirqd/119:59:041
1542914992419,4cyclictest42-21ksoftirqd/321:20:003
1542906992411,3cyclictest26-21ksoftirqd/121:11:461
1542906992410,4cyclictest26-21ksoftirqd/121:26:221
139099240,16rtkit-daemon3056-21PK-Backend00:36:123
139099240,15rtkit-daemon0-21swapper/220:22:492
154291499230,21cyclictest1641301-21runrttasks23:47:443
154291099230,21cyclictest0-21swapper/223:50:112
154290699233,8cyclictest26-21ksoftirqd/121:40:121
1542906992320,2cyclictest0-21swapper/123:39:551
154290699230,6cyclictest3056-21PK-Backend23:05:201
154290699230,21cyclictest1545362-21cpuspeed19:15:111
1542904992315,6cyclictest883-21dbus-daemon20:40:010
16564072220,11sleep126-21ksoftirqd/100:30:121
16445292220,4sleep13056-21PK-Backend23:55:191
15792602220,4sleep30-21swapper/320:50:203
154291499222,15cyclictest1588973-21runrttasks21:20:133
1542914992215,5cyclictest1608662-21diskstats22:15:143
1542914992213,7cyclictest436-20systemd-journal21:30:003
1542910992220,1cyclictest0-21swapper/220:01:312
1542910992211,9cyclictest1590461-21unin-run21:25:002
154291099220,20cyclictest0-21swapper/200:30:272
1542906992220,1cyclictest0-21swapper/122:00:251
1542906992220,1cyclictest0-21swapper/100:20:451
1542906992219,2cyclictest3056-21PK-Backend23:30:291
1542906992218,3cyclictest251rcuc/120:30:001
1542906992211,2cyclictest141rcu_preempt00:02:131
154290699220,21cyclictest3056-21PK-Backend19:49:191
154290699220,20cyclictest3056-21PK-Backend19:31:411
154290699220,20cyclictest16061682sleep122:08:411
154290699220,20cyclictest16061682sleep122:08:411
154290699220,20cyclictest0-21swapper/120:14:331
154291499219,4cyclictest42-21ksoftirqd/323:05:003
154291499219,4cyclictest42-21ksoftirqd/319:50:003
154291499217,2cyclictest141rcu_preempt00:30:163
1542914992119,1cyclictest3056-21PK-Backend21:40:033
154291499211,8cyclictest1550888-21df19:30:133
1542914992118,2cyclictest3056-21PK-Backend21:07:253
1542914992112,3cyclictest42-21ksoftirqd/323:35:223
154291499210,19cyclictest3056-21PK-Backend21:01:093
1542910992119,1cyclictest0-21swapper/221:36:482
1542910992119,1cyclictest0-21swapper/221:04:572
1542910992119,1cyclictest0-21swapper/220:55:042
1542910992119,1cyclictest0-21swapper/220:49:362
1542910992119,1cyclictest0-21swapper/219:55:352
1542910992112,7cyclictest1653071-21df_inode00:20:142
154291099210,20cyclictest0-21swapper/223:24:162
154291099210,20cyclictest0-21swapper/222:52:462
154291099210,20cyclictest0-21swapper/221:31:072
154291099210,20cyclictest0-21swapper/220:39:152
154291099210,20cyclictest0-21swapper/219:53:332
154291099210,20cyclictest0-21swapper/219:41:572
154291099210,20cyclictest0-21swapper/200:16:412
154290699212,7cyclictest26-21ksoftirqd/121:50:151
1542906992119,1cyclictest3056-21PK-Backend23:13:261
1542906992119,1cyclictest3056-21PK-Backend19:25:251
1542906992119,1cyclictest0-21swapper/121:45:111
1542906992119,1cyclictest0-21swapper/121:04:281
1542906992119,1cyclictest0-21swapper/120:58:131
1542906992119,1cyclictest0-21swapper/120:32:461
1542906992119,1cyclictest0-21swapper/120:15:341
1542906992119,1cyclictest0-21swapper/119:12:491
1542906992119,1cyclictest0-21swapper/100:36:191
1542906992118,2cyclictest3056-21PK-Backend22:13:161
1542906992117,3cyclictest251rcuc/120:22:411
1542906992111,2cyclictest141rcu_preempt21:36:331
154290699210,20cyclictest0-21swapper/119:37:081
154290699210,19cyclictest3056-21PK-Backend23:00:411
154290699210,19cyclictest3056-21PK-Backend22:38:101
154290499210,20cyclictest0-21swapper/022:34:200
139099210,13rtkit-daemon3056-21PK-Backend21:47:472
139099210,13rtkit-daemon3056-21PK-Backend21:47:253
16338752200,4sleep13056-21PK-Backend23:25:201
16155722200,3sleep20-21swapper/222:35:132
16057862200,3sleep20-21swapper/222:05:212
16057862200,3sleep20-21swapper/222:05:212
15561282200,3sleep20-21swapper/219:45:142
154291499207,3cyclictest141rcu_preempt00:10:403
154291499206,3cyclictest141rcu_preempt22:20:213
1542914992018,1cyclictest3056-21PK-Backend22:51:133
1542914992018,1cyclictest0-21swapper/322:48:093
154291499201,7cyclictest1642125-21df23:50:133
154291499201,7cyclictest1616804-21cat22:40:023
1542914992017,2cyclictest3056-21PK-Backend20:03:303
1542914992013,5cyclictest1560153-21ntpq19:55:213
1542914992012,3cyclictest42-21ksoftirqd/322:15:003
154291499200,19cyclictest3056-21PK-Backend21:54:013
154291499200,19cyclictest3056-21PK-Backend20:41:233
154291499200,19cyclictest3056-21PK-Backend20:34:533
154291499200,19cyclictest0-21swapper/322:58:373
154291499200,19cyclictest0-21swapper/322:44:043
154291499200,19cyclictest0-21swapper/322:08:433
154291499200,19cyclictest0-21swapper/322:08:423
154291499200,19cyclictest0-21swapper/321:39:013
154291499200,19cyclictest0-21swapper/321:33:203
1542910992018,1cyclictest0-21swapper/223:02:392
1542910992018,1cyclictest0-21swapper/222:48:402
1542910992018,1cyclictest0-21swapper/222:15:082
1542910992018,1cyclictest0-21swapper/221:55:062
1542910992018,1cyclictest0-21swapper/221:28:162
1542910992018,1cyclictest0-21swapper/220:15:232
1542910992018,1cyclictest0-21swapper/219:13:172
1542910992013,6cyclictest1644745-21sed23:55:222
1542910992013,5cyclictest1630923-21seq23:18:092
1542910992012,6cyclictest1628417-21sed23:10:162
154291099200,1cyclictest0-21swapper/219:36:172
154291099200,19cyclictest0-21swapper/223:30:512
154291099200,19cyclictest0-21swapper/222:43:332
154291099200,19cyclictest0-21swapper/222:04:532
154291099200,18cyclictest3056-21PK-Backend20:40:172
154290699204,7cyclictest26-21ksoftirqd/120:00:361
154290699202,7cyclictest26-21ksoftirqd/119:20:161
154290699201,9cyclictest26-21ksoftirqd/121:55:181
1542906992018,1cyclictest3056-21PK-Backend22:29:111
1542906992018,1cyclictest0-21swapper/120:08:531
1542906992018,1cyclictest0-21swapper/120:08:521
154290699200,6cyclictest3056-21PK-Backend19:53:351
154290699200,1cyclictest3056-21PK-Backend21:22:401
154290699200,19cyclictest3056-21PK-Backend22:40:131
154290699200,19cyclictest3056-21PK-Backend00:11:181
154290699200,18cyclictest3056-21PK-Backend22:18:101
154290699200,18cyclictest3056-21PK-Backend21:30:101
154290699200,18cyclictest3056-21PK-Backend19:43:381
154290699200,18cyclictest16238972sleep122:56:571
154290499209,10cyclictest1560940-21unin-run20:00:000
1542904992018,1cyclictest0-21swapper/023:26:250
1542904992018,1cyclictest0-21swapper/021:35:540
1542904992018,1cyclictest0-21swapper/021:00:040
1542904992018,1cyclictest0-21swapper/020:26:180
1542904992018,1cyclictest0-21swapper/019:30:410
1542904992018,1cyclictest0-21swapper/000:39:120
1542904992015,3cyclictest1546807-21munin-run19:20:000
1542904992013,5cyclictest1602574-21munin-plugin-st21:59:590
1542904992013,5cyclictest1563622-21ntp_kernel_pll_20:05:180
1542904992013,5cyclictest1563622-21ntp_kernel_pll_20:05:180
154290499200,1cyclictest3056-21PK-Backend22:46:240
154290499200,1cyclictest0-21swapper/019:53:000
154290499200,19cyclictest0-21swapper/023:38:560
154290499200,19cyclictest0-21swapper/022:28:260
154290499200,19cyclictest0-21swapper/021:42:220
154290499200,19cyclictest0-21swapper/020:52:000
154290499200,19cyclictest0-21swapper/020:31:450
154290499200,19cyclictest0-21swapper/000:23:370
154290499200,19cyclictest0-21swapper/000:15:260
139099200,14rtkit-daemon0-21swapper/200:37:372
15630952190,4chrt3056-21PK-Backend20:05:123
15630952190,4chrt3056-21PK-Backend20:05:123
154291499199,3cyclictest42-21ksoftirqd/323:30:143
1542914991917,1cyclictest3056-21PK-Backend21:55:033
1542914991917,1cyclictest3056-21PK-Backend00:17:183
1542914991917,1cyclictest0-21swapper/323:19:123
1542914991916,2cyclictest3056-21PK-Backend20:55:553
1542914991916,2cyclictest3056-21PK-Backend20:19:333
154291499191,4cyclictest1549651-21python319:25:233
1542914991914,3cyclictest1557829-21diskstats19:50:143
1542914991913,4cyclictest886-21NetworkManager00:00:003
1542914991913,4cyclictest42-21ksoftirqd/300:05:003
1542914991912,5cyclictest42-21ksoftirqd/322:27:053
1542914991911,6cyclictest1626892-21ntpq23:05:193
1542914991911,6cyclictest1569561-21cron20:25:003
154291499190,1cyclictest3056-21PK-Backend20:29:253
154291499190,1cyclictest3056-21PK-Backend00:24:283
154291499190,18cyclictest3056-21PK-Backend20:11:273
154291499190,18cyclictest0-21swapper/323:10:333
154291499190,18cyclictest0-21swapper/322:32:003
154291499190,18cyclictest0-21swapper/322:00:443
154291099198,9cyclictest1650730-21unin-run00:15:002
1542910991917,1cyclictest3056-21PK-Backend21:40:402
1542910991917,1cyclictest0-21swapper/223:26:322
1542910991917,1cyclictest0-21swapper/222:30:282
1542910991917,1cyclictest0-21swapper/222:12:032
1542910991917,1cyclictest0-21swapper/221:11:262
1542910991917,1cyclictest0-21swapper/220:29:562
1542910991915,3cyclictest1612619-21python322:25:212
1542910991913,5cyclictest1640225-21expr23:45:122
1542910991912,5cyclictest1-21systemd23:45:022
154291099190,1cyclictest0-21swapper/223:06:592
154291099190,1cyclictest0-21swapper/221:50:142
154291099190,1cyclictest0-21swapper/219:31:362
154291099190,1cyclictest0-21swapper/219:22:302
154291099190,18cyclictest0-21swapper/219:26:082
154290699199,3cyclictest26-21ksoftirqd/100:06:331
154290699198,4cyclictest26-21ksoftirqd/121:09:491
154290699194,6cyclictest26-21ksoftirqd/100:16:071
154290699194,4cyclictest26-21ksoftirqd/120:42:151
154290699191,8cyclictest26-21ksoftirqd/123:40:211
1542906991913,5cyclictest26-21ksoftirqd/100:30:011
1542906991913,5cyclictest1579377-21smartctl20:50:211
154290699190,6cyclictest3056-21PK-Backend23:55:001
154290699190,6cyclictest3056-21PK-Backend22:20:231
1542904991917,1cyclictest0-21swapper/023:56:470
1542904991917,1cyclictest0-21swapper/022:21:290
1542904991917,1cyclictest0-21swapper/022:09:270
1542904991917,1cyclictest0-21swapper/022:09:260
1542904991917,1cyclictest0-21swapper/021:53:450
1542904991917,1cyclictest0-21swapper/021:46:140
1542904991917,1cyclictest0-21swapper/021:08:100
1542904991917,1cyclictest0-21swapper/020:44:440
1542904991917,1cyclictest0-21swapper/020:19:010
1542904991917,1cyclictest0-21swapper/019:44:270
1542904991917,1cyclictest0-21swapper/000:32:020
1542904991912,6cyclictest1636348-21sed23:35:010
1542904991911,6cyclictest1649987-21awk00:10:200
154290499191,16cyclictest1592170-21apt21:30:000
154290499190,1cyclictest0-21swapper/022:37:250
154290499190,1cyclictest0-21swapper/020:56:260
154290499190,1cyclictest0-21swapper/019:38:460
154290499190,1cyclictest0-21swapper/019:23:260
154290499190,1cyclictest0-21swapper/019:13:240
154290499190,1cyclictest0-21swapper/000:02:560
154290499190,18cyclictest3056-21PK-Backend23:12:400
154290499190,18cyclictest0-21swapper/020:47:340
154290499190,18cyclictest0-21swapper/020:11:440
154290499190,18cyclictest0-21swapper/019:47:180
139099190,13rtkit-daemon0-21swapper/321:10:403
154291499189,2cyclictest42-21ksoftirqd/319:10:503
154291499184,12cyclictest1632808-21cron23:25:003
1542914991816,1cyclictest3056-21PK-Backend20:46:013
1542914991815,2cyclictest3056-21PK-Backend19:20:033
154291499181,3cyclictest141rcu_preempt19:39:213
1542914991810,2cyclictest42-21ksoftirqd/300:25:193
154291499180,8cyclictest3056-21PK-Backend20:35:163
1542910991816,1cyclictest0-21swapper/220:32:472
1542910991816,1cyclictest0-21swapper/220:13:332
1542910991816,1cyclictest0-21swapper/220:05:362
1542910991816,1cyclictest0-21swapper/220:05:362
1542910991813,3cyclictest1622770-21ls22:55:122
1542906991812,5cyclictest1574847-21sed20:40:011
154290699180,6cyclictest3056-21PK-Backend23:23:061
154290699180,5cyclictest3056-21PK-Backend22:50:051
1542904991816,1cyclictest0-21swapper/023:44:170
1542904991816,1cyclictest0-21swapper/023:04:150
1542904991816,1cyclictest0-21swapper/022:59:560
1542904991816,1cyclictest0-21swapper/021:22:420
1542904991816,1cyclictest0-21swapper/021:17:140
1542904991816,1cyclictest0-21swapper/020:02:450
1542904991816,1cyclictest0-21swapper/019:27:030
139099180,13rtkit-daemon0-21swapper/220:53:172
15464592170,9sleep20-21swapper/219:16:122
1542914991715,1cyclictest0-21swapper/319:43:563
1542914991714,2cyclictest3056-21PK-Backend23:43:393
1542910991714,2cyclictest0-21swapper/222:20:142
1542910991712,3cyclictest1583844-21tr21:05:132
1542904991715,1cyclictest0-21swapper/022:41:300
1542904991715,1cyclictest0-21swapper/021:34:520
1542904991715,1cyclictest0-21swapper/020:20:030
154291499168,2cyclictest42-21ksoftirqd/319:18:003
154291099169,5cyclictest1647218-21acpi00:05:122
1542910991610,4cyclictest28650irq/123-ahci[0000:30:002
154290499169,5cyclictest1640566-21sed23:45:160
1542904991614,1cyclictest0-21swapper/023:16:590
1542904991613,2cyclictest1603089-21apt22:00:110
1542904991611,4cyclictest1609017-21cat22:15:180
1542904991610,5cyclictest1654912-21ls00:25:160
154291099159,4cyclictest1095-21runrttasks21:17:562
154290499159,4cyclictest1621202-21grep22:50:170
154290499158,5cyclictest1626483-21cat23:05:130
1542904991513,1cyclictest0-21swapper/022:12:300
1542904991412,1cyclictest0-21swapper/023:50:390
1542904991410,3cyclictest1631486-21tr23:20:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional