You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-08 - 13:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Fri May 08, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1589735995044,4cyclictest1682728-21kworker/u8:3+events_unbound23:53:272
1589735994933,12cyclictest311ktimers/223:05:122
1589735994634,9cyclictest311ktimers/221:15:122
1589738994537,5cyclictest1593669-21sendmail19:20:013
1589735994233,6cyclictest1645427-21fschecks_count21:50:162
158973199421,7cyclictest0-21swapper/120:45:131
1589726994235,4cyclictest1687893-21cron23:55:010
1589738994133,6cyclictest391ktimers/321:30:133
1589735994134,4cyclictest1593666-21cron19:20:012
1589735994134,4cyclictest0-21swapper/223:00:162
1589735994129,8cyclictest0-21swapper/222:05:262
1589731994132,4cyclictest0-21swapper/122:43:161
1589738994033,5cyclictest1665956-21kworker/u8:4+events_unbound22:58:183
1589738994029,8cyclictest391ktimers/319:40:123
1589738994020,5cyclictest1636516-21kworker/u8:3+events_unbound21:40:213
1589735994033,4cyclictest1669131-21cron23:00:002
1589731994029,8cyclictest0-21swapper/122:05:001
1589731994029,8cyclictest0-21swapper/122:05:001
1589738993931,4cyclictest0-21swapper/323:25:273
1589738993930,5cyclictest1675953-21cron23:20:003
1589738993928,7cyclictest0-21swapper/323:20:263
1589738993926,8cyclictest1699597-21grep00:25:253
1589738993926,8cyclictest1699597-21grep00:25:253
1589738993921,5cyclictest131rcu_preempt23:33:403
1589731993930,5cyclictest1703453-21cron00:40:001
1589726993932,4cyclictest1597088-21munin-plugin-st19:30:010
1589726993931,5cyclictest1685949-21kworker/u8:1+events_unbound00:28:350
1589726993931,5cyclictest1685949-21kworker/u8:1+events_unbound00:28:350
1589738993831,5cyclictest1644894-21kworker/u8:1+events_unbound22:02:413
1589738993831,5cyclictest1644894-21kworker/u8:1+events_unbound22:02:413
1589738993828,7cyclictest0-21swapper/322:20:013
1589738993825,7cyclictest0-21swapper/322:35:263
158973899381,15cyclictest0-21swapper/320:25:123
1589735993831,3cyclictest0-21swapper/219:25:012
1589731993822,5cyclictest1647223-21kworker/u8:0+events_unbound21:58:421
1589731993821,6cyclictest1573971-21kworker/u8:4+events_unbound19:35:151
1589738993731,4cyclictest1629632-21kworker/u8:1+events_unbound21:12:523
1589738993729,4cyclictest0-21swapper/321:45:173
1589738993728,6cyclictest1620475-21grep20:35:243
1589738993728,5cyclictest1614134-21munin-plugin-st20:20:013
1589738993717,3cyclictest131rcu_preempt22:10:403
1589735993726,6cyclictest0-21swapper/221:30:012
1589731993730,5cyclictest1620667-21kworker/u8:0+events_unbound20:57:501
1589731993729,5cyclictest0-21swapper/120:54:591
1589731993728,6cyclictest0-21swapper/123:25:001
1589731993717,5cyclictest1620667-21kworker/u8:0+events_unbound20:39:351
1589731993710,18cyclictest24-21ksoftirqd/123:50:091
1589738993628,6cyclictest391ktimers/322:25:113
1589738993620,5cyclictest131rcu_preempt20:50:243
1589735993630,4cyclictest1641639-21munin-run21:40:002
1589735993630,4cyclictest1641456-21kworker/u8:2+events_unbound21:42:582
1589735993627,5cyclictest1595081-21kworker/u8:1+events_unbound19:55:262
1589735993611,14cyclictest32-21ksoftirqd/220:45:132
1589731993616,5cyclictest1661854-21kworker/u8:0+events_unbound23:05:481
1589726993627,6cyclictest1682775-21cron23:40:000
1589726993627,6cyclictest1682775-21cron23:40:000
1589726993625,8cyclictest1662111-21munin-run22:40:010
1589738993525,6cyclictest0-21swapper/321:00:253
1589738993518,4cyclictest131rcu_preempt21:20:163
1589738993512,12cyclictest40-21ksoftirqd/323:45:203
1589735993525,6cyclictest0-21swapper/222:20:012
1589735993525,6cyclictest0-21swapper/221:30:272
1589726993527,6cyclictest1661854-21kworker/u8:0+events_unbound22:43:180
1589726993526,6cyclictest0-21swapper/000:40:000
1589726993525,7cyclictest0-21swapper/020:15:170
158973899347,22cyclictest391ktimers/321:55:243
1589738993422,8cyclictest1600047-21grep19:35:253
1589738993418,5cyclictest131rcu_preempt20:05:153
1589738993416,6cyclictest1595081-21kworker/u8:1+events_unbound20:01:073
1589738993416,5cyclictest131rcu_preempt00:15:243
1589738993413,11cyclictest131rcu_preempt00:15:003
1589738993412,12cyclictest40-21ksoftirqd/319:55:003
1589738993412,12cyclictest40-21ksoftirqd/319:55:003
1589738993411,7cyclictest40-21ksoftirqd/300:30:253
1589738993411,7cyclictest40-21ksoftirqd/300:30:253
1589735993424,7cyclictest0-21swapper/220:50:262
1589735993424,6cyclictest0-21swapper/223:55:272
1589735993424,6cyclictest0-21swapper/223:30:272
1589731993426,5cyclictest1564098-21kworker/u8:3+events_unbound19:11:421
1589731993426,4cyclictest0-21swapper/122:20:011
1589731993426,4cyclictest0-21swapper/120:40:251
1589731993416,6cyclictest1685949-21kworker/u8:1+events_unbound00:17:191
1589726993423,7cyclictest0-21swapper/023:00:260
158973899339,7cyclictest40-21ksoftirqd/321:27:543
1589738993327,4cyclictest1651769-21kworker/u8:3+events_unbound22:23:093
1589738993325,4cyclictest0-21swapper/320:00:003
1589738993323,6cyclictest0-21swapper/319:20:173
1589738993317,4cyclictest131rcu_preempt22:40:263
1589738993315,5cyclictest131rcu_preempt19:25:153
1589738993313,11cyclictest131rcu_preempt22:50:183
1589735993326,4cyclictest1665530-21munin-plugin-st22:50:002
1589735993325,4cyclictest0-21swapper/219:10:172
1589735993324,6cyclictest0-21swapper/222:15:002
1589735993323,6cyclictest0-21swapper/222:40:252
1589735993323,6cyclictest0-21swapper/222:25:232
1589735993323,6cyclictest0-21swapper/219:40:252
1589735993323,6cyclictest0-21swapper/219:30:262
1589735993322,6cyclictest0-21swapper/223:25:272
1589735993322,6cyclictest0-21swapper/222:20:252
1589731993325,4cyclictest0-21swapper/121:45:271
1589731993322,8cyclictest1596613-21grep19:25:261
1589726993325,5cyclictest1647983-21unixbench_multi21:55:250
1589738993225,4cyclictest1691074-21unixbench_multi00:00:283
1589738993224,4cyclictest0-21swapper/321:05:273
1589738993222,7cyclictest1633477-21fschecks_count21:15:153
1589738993211,4cyclictest381rcuc/322:50:003
1589738993210,12cyclictest40-21ksoftirqd/322:30:163
1589735993222,6cyclictest0-21swapper/200:00:282
1589735993221,9cyclictest0-21swapper/223:45:122
1589735993221,7cyclictest0-21swapper/219:55:002
1589735993221,7cyclictest0-21swapper/219:55:002
1589731993225,4cyclictest0-21swapper/121:25:011
1589731993221,7cyclictest0-21swapper/121:05:271
1589731993220,5cyclictest131rcu_preempt21:54:311
1589726993223,6cyclictest0-21swapper/023:10:000
158973899319,11cyclictest40-21ksoftirqd/300:05:253
158973899317,12cyclictest40-21ksoftirqd/321:50:243
1589738993120,8cyclictest1615859-21cut20:25:013
1589738993119,7cyclictest0-21swapper/321:00:003
158973899311,6cyclictest40-21ksoftirqd/323:10:003
1589738993112,5cyclictest131rcu_preempt23:35:123
1589738993112,5cyclictest131rcu_preempt23:35:123
1589735993117,5cyclictest1607549-21kworker/u8:3+events_unbound20:09:302
1589731993125,4cyclictest1685949-21kworker/u8:1+events_unbound00:13:331
1589731993124,4cyclictest1686205-21kthreadd23:50:001
1589731993123,5cyclictest0-21swapper/123:35:001
1589731993112,10cyclictest131rcu_preempt22:35:251
1589726993121,6cyclictest0-21swapper/022:20:010
1589726993121,6cyclictest0-21swapper/019:45:270
158973899309,5cyclictest131rcu_preempt19:10:193
158973899305,7cyclictest40-21ksoftirqd/323:05:003
1589738993022,5cyclictest1651871-21sh22:10:003
1589738993022,4cyclictest0-21swapper/320:10:253
1589738993020,6cyclictest1603477-21head19:45:273
1589738993017,3cyclictest131rcu_preempt23:10:243
1589738993014,5cyclictest131rcu_preempt00:20:163
1589738993014,5cyclictest131rcu_preempt00:00:013
1589738993013,5cyclictest131rcu_preempt20:50:003
1589735993024,4cyclictest1616076-21kworker/u8:2+events_unbound21:07:522
1589735993022,5cyclictest0-21swapper/221:15:012
1589735993016,5cyclictest1685949-21kworker/u8:1+events_unbound00:11:482
1589735993011,12cyclictest32-21ksoftirqd/221:20:232
1589731993023,4cyclictest0-21swapper/122:10:001
1589731993023,4cyclictest0-21swapper/121:00:161
1589731993023,4cyclictest0-21swapper/119:40:251
1589731993021,6cyclictest0-21swapper/123:35:251
1589731993021,6cyclictest0-21swapper/123:35:251
1589731993020,5cyclictest1675972-21grep23:20:001
1589731993019,6cyclictest231ktimers/122:50:121
1589731993017,6cyclictest1636516-21kworker/u8:3+events_unbound21:25:181
1589726993024,4cyclictest1689822-21munin-plugin-st00:00:000
1589726993022,5cyclictest0-21swapper/021:20:010
1589726993022,5cyclictest0-21swapper/019:55:000
1589726993022,5cyclictest0-21swapper/019:55:000
1589726993021,5cyclictest0-21swapper/021:40:000
1589726993021,5cyclictest0-21swapper/021:05:270
1589726993020,6cyclictest0-21swapper/021:30:010
1589726993019,6cyclictest0-21swapper/020:47:440
158973899298,12cyclictest40-21ksoftirqd/319:34:513
1589738992917,6cyclictest0-21swapper/300:40:003
1589735992921,5cyclictest0-21swapper/219:30:012
1589735992920,6cyclictest0-21swapper/219:40:012
1589735992920,6cyclictest0-21swapper/200:35:182
1589735992916,4cyclictest1620667-21kworker/u8:0+events_unbound20:55:162
1589735992912,11cyclictest32-21ksoftirqd/222:50:172
158973199298,8cyclictest131rcu_preempt22:20:121
1589731992923,4cyclictest1687696-21kworker/u8:0+events_unbound00:03:291
1589731992922,5cyclictest1665522-21apt-get22:50:001
1589731992922,4cyclictest0-21swapper/121:30:271
1589731992922,4cyclictest0-21swapper/119:20:261
1589731992921,5cyclictest0-21swapper/119:50:001
1589731992921,4cyclictest0-21swapper/121:40:261
1589731992921,4cyclictest0-21swapper/119:55:261
1589731992920,6cyclictest0-21swapper/120:20:011
1589731992911,11cyclictest1682728-21kworker/u8:3+events_unbound23:55:211
1589726992923,3cyclictest1677681-21kthreadd23:25:000
1589726992919,7cyclictest1598297-21grep19:30:250
1589726992919,6cyclictest0-21swapper/023:13:210
1589738992821,5cyclictest1672268-21kworker/u8:2+events_unbound23:52:013
1589738992821,4cyclictest0-21swapper/321:35:253
1589738992817,8cyclictest1622242-21grep20:40:253
1589738992812,4cyclictest131rcu_preempt23:40:113
158973599287,11cyclictest0-21swapper/220:10:152
1589735992821,4cyclictest0-21swapper/223:40:252
1589735992819,6cyclictest0-21swapper/223:20:262
1589735992818,6cyclictest0-21swapper/223:15:002
158973599281,7cyclictest1645137-21latency_hist21:50:012
158973199289,4cyclictest131rcu_preempt00:20:141
158973199287,7cyclictest1640852-21sendmail_mailqu21:35:231
1589731992821,5cyclictest1616076-21kworker/u8:2+events_unbound20:26:411
1589731992814,8cyclictest131rcu_preempt20:31:491
158973199280,21cyclictest1610581-21taskset20:08:201
1589726992821,4cyclictest1627985-21kthreadd21:00:000
1589726992821,4cyclictest0-21swapper/019:45:000
1589726992821,3cyclictest0-21swapper/023:00:000
1589726992816,6cyclictest1620667-21kworker/u8:0+events_unbound21:22:150
1589735992721,3cyclictest0-21swapper/220:35:242
1589735992720,5cyclictest1685949-21kworker/u8:1+events_unbound00:25:002
1589735992719,5cyclictest0-21swapper/220:25:152
1589735992718,6cyclictest0-21swapper/221:00:162
1589735992714,5cyclictest1672268-21kworker/u8:2+events_unbound23:18:532
1589735992713,7cyclictest32-21ksoftirqd/200:15:182
1589735992710,10cyclictest32-21ksoftirqd/220:45:012
1589731992721,4cyclictest1691489-21kworker/u8:3+events_unbound00:35:001
1589731992721,4cyclictest1691489-21kworker/u8:3+events_unbound00:34:591
1589731992719,4cyclictest0-21swapper/122:25:231
1589726992721,4cyclictest1629632-21kworker/u8:1+events_unbound21:32:570
1589726992719,5cyclictest0-21swapper/022:30:270
1589726992719,4cyclictest0-21swapper/021:50:130
158972699271,7cyclictest1598427-21kworker/u8:2+events_unbound19:35:170
1589726992717,6cyclictest0-21swapper/023:45:250
1589726992717,6cyclictest0-21swapper/023:28:220
1589726992717,6cyclictest0-21swapper/019:20:010
1589726992717,6cyclictest0-21swapper/000:25:000
158972699271,24cyclictest0-21swapper/020:30:120
1589726992710,10cyclictest1644894-21kworker/u8:1+events_unbound22:45:190
158973899268,11cyclictest40-21ksoftirqd/320:35:013
1589735992620,4cyclictest1595081-21kworker/u8:1+events_unbound20:17:362
1589735992619,5cyclictest1655023-21kworker/u8:2+events_unbound22:31:072
1589735992619,4cyclictest1603898-21sh19:50:002
1589735992616,6cyclictest0-21swapper/220:20:252
158973599261,5cyclictest0-21swapper/220:00:112
158973199268,4cyclictest131rcu_preempt00:08:301
158973199265,13cyclictest24-21ksoftirqd/123:00:161
1589731992618,5cyclictest1644894-21kworker/u8:1+events_unbound22:10:231
1589731992618,5cyclictest0-21swapper/120:25:001
1589731992618,5cyclictest0-21swapper/119:50:161
1589731992618,5cyclictest0-21swapper/119:50:161
1589731992612,7cyclictest131rcu_preempt19:34:131
1589731992611,7cyclictest24-21ksoftirqd/120:00:241
158973199261,14cyclictest0-21swapper/123:10:281
158972699265,4cyclictest131rcu_preempt19:15:010
1589726992620,3cyclictest16058402sleep019:55:140
1589726992618,5cyclictest0-21swapper/020:35:240
1589726992618,5cyclictest0-21swapper/020:20:250
1589726992618,4cyclictest0-21swapper/000:10:150
1589726992617,6cyclictest1624953-21grep20:50:160
1589726992617,6cyclictest0-21swapper/000:30:140
1589726992617,6cyclictest0-21swapper/000:30:140
1589726992617,5cyclictest0-21swapper/022:30:010
1589726992617,5cyclictest0-21swapper/021:15:010
1589726992613,9cyclictest1651402-21grep22:05:260
1589726992610,10cyclictest1675951-21kworker/u8:1+events_unbound23:30:560
1589735992517,5cyclictest0-21swapper/223:35:212
1589735992517,5cyclictest0-21swapper/223:35:212
1589735992517,5cyclictest0-21swapper/200:25:232
1589735992517,5cyclictest0-21swapper/200:25:232
1589735992516,6cyclictest1617876-21ls20:30:142
158973199256,11cyclictest24-21ksoftirqd/123:40:141
1589731992519,4cyclictest1595081-21kworker/u8:1+events_unbound20:14:411
1589731992518,5cyclictest1658615-21kworker/u8:3+events_unbound22:33:301
1589731992510,9cyclictest131rcu_preempt21:15:171
1589731992510,9cyclictest131rcu_preempt00:25:171
1589731992510,9cyclictest131rcu_preempt00:25:171
1589726992516,5cyclictest0-21swapper/000:15:250
158972699251,4cyclictest1642224-21irqstats21:40:180
158972699251,20cyclictest0-21swapper/020:08:060
1589735992417,5cyclictest0-21swapper/200:05:252
158973199246,9cyclictest24-21ksoftirqd/122:55:111
1589731992416,5cyclictest0-21swapper/123:25:261
1589731992412,3cyclictest24-21ksoftirqd/119:15:141
158972699246,9cyclictest131rcu_preempt21:00:250
158972699245,9cyclictest131rcu_preempt20:00:240
158972699245,3cyclictest131rcu_preempt22:00:230
158972699245,3cyclictest131rcu_preempt22:00:230
1589726992418,3cyclictest1652408-21if_eth022:10:190
158972699241,6cyclictest1667487-21latency_hist22:55:010
1589726992414,7cyclictest11-21ksoftirqd/023:40:190
1589726992414,6cyclictest0-21swapper/022:25:010
1589726992414,6cyclictest0-21swapper/000:05:250
1589735992317,3cyclictest0-21swapper/200:30:152
1589735992317,3cyclictest0-21swapper/200:30:152
1589735992314,6cyclictest0-21swapper/222:00:252
1589735992314,6cyclictest0-21swapper/222:00:252
1589735992314,5cyclictest0-21swapper/221:55:162
1589726992317,3cyclictest0-21swapper/019:20:210
1589726992316,3cyclictest0-21swapper/000:01:360
1589726992312,6cyclictest0-21swapper/020:40:250
1589726992311,3cyclictest11-21ksoftirqd/020:10:250
158972699230,19cyclictest0-21swapper/021:47:310
158973599226,9cyclictest131rcu_preempt22:35:212
158972699221,13cyclictest0-21swapper/020:25:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional