You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-25 - 16:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Tue Aug 25, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1503305994944,3cyclictest1465588-21kworker/u8:1+events_unbound09:00:132
1503300994639,4cyclictest1825536-21latency_hist12:20:001
1503297994438,4cyclictest1736980-21gpgv10:55:000
1503300994339,3cyclictest1736865-21apt-get10:55:021
1503300994337,4cyclictest1591683-21base6408:35:011
1503307994236,4cyclictest1565296-21latency_hist08:10:013
1503305994238,3cyclictest1465588-21kworker/u8:1+events_unbound09:44:022
1503297994135,4cyclictest1794567-21latency_hist11:50:010
1503300994033,5cyclictest1534273-21latency_hist07:40:001
1503305993835,2cyclictest1539478-21kworker/u8:0+events_unbound07:58:442
1503305993835,2cyclictest1465588-21kworker/u8:1+events_unbound09:48:012
1503305993834,3cyclictest1804912-21kworker/u8:3+events_unbound12:07:012
1503300993834,3cyclictest1768788-21kworker/u8:0+flush-259:011:50:171
1503297993835,2cyclictest1539478-21kworker/u8:0+events_unbound07:52:000
1503297993835,2cyclictest1465588-21kworker/u8:1+events_unbound12:05:260
1503305993734,2cyclictest1518800-21kworker/u8:4+events_unbound07:42:022
1503305993734,2cyclictest1518800-21kworker/u8:4+events_unbound07:34:022
1503305993633,2cyclictest1758439-21kworker/u8:2+events_unbound11:54:012
1503305993633,2cyclictest1633152-21kworker/u8:0+events_unbound09:23:022
1503305993633,2cyclictest1472519-21kworker/u8:2+events_unbound07:21:592
1503297993633,2cyclictest1465588-21kworker/u8:1+events_unbound11:56:000
1503297993632,3cyclictest1669177-21kworker/u8:0+events_unbound09:49:590
1503297993632,3cyclictest1539478-21kworker/u8:0+events_unbound08:06:010
1503305993532,2cyclictest1804912-21kworker/u8:3+events_unbound12:19:252
1503305993532,2cyclictest1539478-21kworker/u8:0+events_unbound08:01:022
1503300993529,4cyclictest1695716-21apt-get10:15:121
1503297993532,2cyclictest1465588-21kworker/u8:1+events_unbound11:20:230
1503297993531,3cyclictest1472519-21kworker/u8:2+events_unbound07:10:290
1503305993431,2cyclictest1659245-21kworker/u8:4+events_unbound10:22:022
1503305993430,3cyclictest1465588-21kworker/u8:1+events_unbound09:39:012
1503300993431,2cyclictest1465588-21kworker/u8:1+flush-259:007:10:311
1503305993330,2cyclictest1804912-21kworker/u8:3+events_unbound12:10:242
1503305993330,2cyclictest1669177-21kworker/u8:0+events_unbound09:58:572
1503305993330,2cyclictest1465588-21kworker/u8:1+events_unbound08:18:002
1503300993330,2cyclictest1643280-21kworker/u8:3+events_unbound09:40:201
1503297993330,2cyclictest1659245-21kworker/u8:4+events_unbound10:10:240
1503297993329,3cyclictest1465588-21kworker/u8:1+events_unbound09:05:220
1503297993328,2cyclictest1465588-21kworker/u8:1+events_unbound07:45:170
1503305993229,2cyclictest1758439-21kworker/u8:2+events_unbound11:40:152
1503305993229,2cyclictest1622843-21kworker/u8:2+events_unbound09:08:002
1503305993229,2cyclictest1465588-21kworker/u8:1+events_unbound10:44:062
1503305993229,2cyclictest1465588-21kworker/u8:1+events_unbound10:44:062
1503300993228,3cyclictest1758439-21kworker/u8:2+flush-259:011:25:001
1503297993228,3cyclictest1529357-21kworker/u8:3+events_unbound08:00:220
1503305993129,2cyclictest1465588-21kworker/u8:1+events_unbound07:25:282
1503305993128,2cyclictest1465588-21kworker/u8:1+events_unbound10:58:012
1503297993128,2cyclictest1591167-21kworker/u8:0+events_unbound09:04:030
1503297993128,2cyclictest1570706-21kworker/u8:2+events_unbound08:25:140
1503297993128,2cyclictest1529357-21kworker/u8:3+events_unbound08:10:120
1503297993128,2cyclictest1465588-21kworker/u8:1+events_unbound11:35:220
1503297993127,3cyclictest1685095-21kworker/u8:2+events_unbound10:09:010
1503297993026,3cyclictest1518800-21kworker/u8:4+events_unbound07:27:010
1503305992926,2cyclictest1472519-21kworker/u8:2+events_unbound07:15:272
1503300992922,5cyclictest1804901-21latency_hist12:00:021
1503297992923,4cyclictest335557-21systemd-journal07:42:590
1503307992824,2cyclictest1758439-21kworker/u8:2+flush-259:011:45:003
1503305992826,2cyclictest1758439-21kworker/u8:2+events_unbound11:23:002
1503305992825,2cyclictest1465588-21kworker/u8:1+events_unbound10:00:072
1503305992823,3cyclictest335557-21systemd-journal10:20:002
1503297992825,2cyclictest1768788-21kworker/u8:0+events_unbound11:54:210
1503297992824,3cyclictest1472519-21kworker/u8:2+flush-259:007:20:000
1503297992822,4cyclictest1680343-21diskstats10:00:140
1503307992723,3cyclictest1570706-21kworker/u8:2+flush-259:008:50:163
1503305992725,2cyclictest1570706-21kworker/u8:2+events_unbound08:50:142
1503305992723,2cyclictest1815244-21kworker/u8:0+events_unbound12:25:152
1503297992724,2cyclictest1617434-21kworker/u8:3+events_unbound09:12:000
1503307992621,3cyclictest1664674-21apt-get09:45:113
1503307992621,3cyclictest1659245-21kworker/u8:4+flush-259:010:25:003
1503307992621,3cyclictest1633152-21kworker/u8:0+flush-259:009:35:243
1503300992622,3cyclictest1669829-21apt-get09:50:121
1503300992621,4cyclictest1550124-21apt-get07:55:121
1503297992623,2cyclictest1643280-21kworker/u8:3+events_unbound09:40:160
1503297992619,5cyclictest335557-21systemd-journal08:40:010
1503307992522,2cyclictest1465588-21kworker/u8:1+flush-259:007:20:163
1503305992523,2cyclictest1570706-21kworker/u8:2+events_unbound08:31:002
1503305992522,2cyclictest1518800-21kworker/u8:4+events_unbound07:36:002
1503297992522,2cyclictest1758439-21kworker/u8:2+events_unbound11:40:170
1503297992522,2cyclictest1747626-21kworker/u8:3+events_unbound11:05:200
150329799252,22cyclictest1617437-21munin-run09:00:010
1503307992421,2cyclictest1529357-21kworker/u8:3+events_unbound07:35:243
1503305992419,4cyclictest1716372-21/usr/sbin/munin10:35:142
1503305992419,4cyclictest1716372-21/usr/sbin/munin10:35:142
1503300992418,4cyclictest1721285-21latency_hist10:40:001
1503300992418,4cyclictest1721285-21latency_hist10:40:001
1503300992418,4cyclictest1570469-21latency_hist08:15:011
1503300992418,4cyclictest1465588-21kworker/u8:1+events_unbound09:15:181
1503297992421,2cyclictest1690483-21kworker/u8:0+events_unbound11:00:160
1503297992421,2cyclictest1465588-21kworker/u8:1+events_unbound12:35:220
1503307992316,5cyclictest1674734-21latency_hist09:55:003
1503305992320,2cyclictest1570706-21kworker/u8:2+events_unbound08:40:072
1503305992319,3cyclictest335557-21systemd-journal10:15:002
1503305992319,3cyclictest1748229-21cp11:05:012
1503305992318,4cyclictest1638083-21latency_hist09:20:012
1503300992320,2cyclictest1529357-21kworker/u8:3+flush-259:007:55:001
1503300992317,4cyclictest1725562-21ntpq10:40:211
1503300992317,4cyclictest1725562-21ntpq10:40:211
1503297992321,2cyclictest1465588-21kworker/u8:1+events_unbound10:29:010
1503297992320,2cyclictest1711165-21kworker/u8:3+events_unbound10:45:130
1503297992320,2cyclictest1633152-21kworker/u8:0+events_unbound09:35:250
1503297992320,2cyclictest1465588-21kworker/u8:1+flush-259:010:36:020
1503297992320,2cyclictest1465588-21kworker/u8:1+flush-259:010:36:020
1503297992320,2cyclictest1465588-21kworker/u8:1+events_unbound07:20:210
1503307992218,3cyclictest1758439-21kworker/u8:2+flush-259:011:15:163
1503307992218,3cyclictest1529357-21kworker/u8:3+flush-259:008:15:243
1503307992218,3cyclictest1465588-21kworker/u8:1+events_unbound07:45:153
1503307992217,3cyclictest1799982-21apt-get11:55:113
1503307992216,4cyclictest1617404-21latency_hist09:00:013
1503305992220,2cyclictest1758439-21kworker/u8:2+events_unbound11:18:032
1503305992220,1cyclictest1758439-21kworker/u8:2+events_unbound11:45:252
1503305992219,2cyclictest1617434-21kworker/u8:3+events_unbound09:13:012
1503300992219,2cyclictest1465588-21kworker/u8:1+flush-259:012:35:261
1503300992218,3cyclictest1737172-21latency_hist10:55:001
1503307992118,2cyclictest1742420-21cron11:00:003
1503307992118,2cyclictest1726494-21turbostat.cron10:45:013
1503307992118,2cyclictest1726494-21turbostat.cron10:45:003
1503307992118,2cyclictest1643280-21kworker/u8:3+events_unbound09:30:003
1503307992118,2cyclictest1472519-21kworker/u8:2+events_unbound07:15:193
1503307992117,3cyclictest1659245-21kworker/u8:4+events_unbound10:07:003
1503305992119,2cyclictest1465588-21kworker/u8:1+events_unbound11:05:002
1503305992118,2cyclictest1685095-21kworker/u8:2+events_unbound10:08:012
1503305992116,3cyclictest1580845-21latency_hist08:25:012
1503305992113,1cyclictest191rcu_preempt10:50:002
1503300992118,2cyclictest1633152-21kworker/u8:0+flush-259:009:20:231
1503300992118,2cyclictest1465588-21kworker/u8:1+flush-259:009:55:161
1503297992118,2cyclictest1465588-21kworker/u8:1+events_unbound07:30:210
1503297992114,5cyclictest335557-21systemd-journal12:19:590
1503307992017,2cyclictest1633152-21kworker/u8:0+events_unbound09:30:253
1503307992017,2cyclictest1465588-21kworker/u8:1+flush-259:010:45:163
1503307992015,3cyclictest1758439-21kworker/u8:2+flush-259:011:30:173
1503307992014,4cyclictest1503674-21diskstats07:10:193
1503305992017,2cyclictest1591167-21kworker/u8:0+events_unbound08:45:262
1503305992017,2cyclictest1465588-21kworker/u8:1+events_unbound10:25:112
1503305992017,2cyclictest1465588-21kworker/u8:1+events_unbound07:45:262
1503300992016,3cyclictest1539728-21apt-get07:45:121
1503300992016,3cyclictest1465588-21kworker/u8:1+flush-259:011:10:001
1503297992017,2cyclictest1633152-21kworker/u8:0+events_unbound09:30:290
1503297992016,2cyclictest1529357-21kworker/u8:3+events_unbound08:15:210
1503307991916,2cyclictest1804912-21kworker/u8:3+events_unbound12:25:233
1503307991916,2cyclictest1622843-21kworker/u8:2+events_unbound09:05:253
1503307991915,3cyclictest1747626-21kworker/u8:3+events_unbound11:05:183
1503305991917,2cyclictest1570706-21kworker/u8:2+events_unbound08:39:572
1503305991917,2cyclictest1465588-21kworker/u8:1+events_unbound11:11:012
1503305991916,2cyclictest1841248-21kworker/u8:0+events_unbound12:38:002
1503305991916,2cyclictest1804912-21kworker/u8:3+events_unbound12:21:022
1503305991914,4cyclictest1736865-21apt-get10:55:002
1503300991916,2cyclictest1529116-21idleruntime-cro07:35:001
1503300991915,3cyclictest1643280-21kworker/u8:3+events_unbound09:45:201
1503300991915,3cyclictest1465588-21kworker/u8:1+events_unbound11:35:201
1503300991915,3cyclictest1465588-21kworker/u8:1+events_unbound10:30:211
1503297991915,3cyclictest1769014-21apt-get11:25:130
1503297991913,2cyclictest191rcu_preempt09:30:010
1503307991814,3cyclictest335557-21systemd-journal07:45:003
1503307991814,3cyclictest1804912-21kworker/u8:3+events_unbound12:15:233
1503307991814,3cyclictest1804912-21kworker/u8:3+events_unbound12:10:013
1503307991814,3cyclictest1726514-21kworker/u8:2+events_unbound10:50:193
1503307991814,3cyclictest1570706-21kworker/u8:2+events_unbound08:35:213
1503307991814,2cyclictest1465588-21kworker/u8:1+events_unbound12:35:153
1503305991816,1cyclictest1465588-21kworker/u8:1+events_unbound10:32:072
1503305991815,2cyclictest1529357-21kworker/u8:3+events_unbound08:14:012
1503305991815,1cyclictest0-21swapper/208:30:002
1503300991816,1cyclictest1633152-21kworker/u8:0+flush-259:009:35:211
1503300991815,2cyclictest1831395-21irqcore12:25:161
1503300991815,2cyclictest1523953-21turbostat.cron07:30:011
1503300991815,2cyclictest0-21swapper/109:30:001
1503300991814,3cyclictest1685095-21kworker/u8:2+events_unbound10:05:241
1503300991814,3cyclictest1591471-21base6408:35:011
1503300991813,3cyclictest1648701-21apt-get09:30:131
1503297991816,1cyclictest0-21swapper/012:25:000
1503297991815,2cyclictest1465588-21kworker/u8:1+events_unbound09:55:170
1503297991814,3cyclictest335557-21systemd-journal10:41:000
1503297991814,3cyclictest335557-21systemd-journal10:41:000
1503297991814,1cyclictest191rcu_preempt12:30:180
1503307991714,2cyclictest1570706-21kworker/u8:2+flush-259:008:25:203
1503307991714,2cyclictest1529357-21kworker/u8:3+events_unbound08:12:023
1503307991713,3cyclictest1804912-21kworker/u8:3+events_unbound12:25:003
1503307991713,3cyclictest1465588-21kworker/u8:1+flush-259:007:25:253
150330599176,2cyclictest0-21swapper/211:30:142
1503305991714,2cyclictest1465588-21kworker/u8:1+events_unbound09:33:552
1503305991714,2cyclictest1465588-21kworker/u8:1+events_unbound08:58:472
1503300991713,3cyclictest1804912-21kworker/u8:3+flush-259:012:20:251
1503300991713,2cyclictest0-21swapper/111:20:001
1503300991713,2cyclictest0-21swapper/107:25:011
1503300991712,4cyclictest1810040-21latency_hist12:05:001
150329799177,1cyclictest191rcu_preempt11:15:210
1503297991713,3cyclictest1518800-21kworker/u8:4+events_unbound07:37:320
1503307991613,2cyclictest1783330-21ntp_kernel_err11:35:203
1503307991613,2cyclictest1465588-21kworker/u8:1+flush-259:007:30:213
1503307991612,3cyclictest1465588-21kworker/u8:1+events_unbound12:05:213
1503307991612,3cyclictest1465588-21kworker/u8:1+events_unbound12:03:013
1503307991611,4cyclictest1659245-21kworker/u8:4+events_unbound10:10:183
1503307991610,4cyclictest1799724-21latency_hist11:55:013
1503300991613,2cyclictest1465588-21kworker/u8:1+events_unbound11:10:221
150329799167,1cyclictest191rcu_preempt10:25:000
1503297991613,2cyclictest1607782-21irqcore08:50:170
1503297991613,2cyclictest1529357-21kworker/u8:3+events_unbound08:30:190
1503297991613,2cyclictest0-21swapper/009:25:010
1503307991512,2cyclictest1591167-21kworker/u8:0+events_unbound08:45:133
1503307991512,2cyclictest1576927-21tr08:20:163
1503307991511,3cyclictest1747626-21kworker/u8:3+events_unbound11:13:023
1503307991511,3cyclictest1643280-21kworker/u8:3+flush-259:009:40:173
1503307991511,3cyclictest1465588-21kworker/u8:1+events_unbound10:00:233
150330599156,1cyclictest191rcu_preempt09:50:222
150330599155,3cyclictest41-21ksoftirqd/207:10:282
150330599152,2cyclictest1647565-21ntpq09:25:222
1503305991513,2cyclictest1539478-21kworker/u8:0+events_unbound08:05:272
1503305991512,2cyclictest1465588-21kworker/u8:1+events_unbound11:35:552
150330099159,5cyclictest1747713-21gpgv11:05:001
1503300991512,2cyclictest1465588-21kworker/u8:1+events_unbound12:05:231
1503300991510,4cyclictest1622878-21apt-get09:05:131
150329799159,1cyclictest191rcu_preempt12:25:170
150329799158,1cyclictest191rcu_preempt11:10:180
150329799158,1cyclictest191rcu_preempt09:50:170
150329799157,2cyclictest191rcu_preempt10:55:170
150329799157,1cyclictest191rcu_preempt12:00:150
150329799157,1cyclictest191rcu_preempt11:30:170
1503297991513,1cyclictest60350irq/132-enp0s29f1:rx-008:47:050
1503297991513,1cyclictest60350irq/132-enp0s29f1:rx-008:20:150
1503297991512,2cyclictest61150irq/133-enp0s29f1:tx-009:15:160
1503297991512,2cyclictest1539478-21kworker/u8:0+events_unbound07:58:450
1503297991510,1cyclictest191rcu_preempt08:35:010
150330799148,4cyclictest1539478-21kworker/u8:0+flush-259:008:04:063
1503307991412,1cyclictest1591166-21https08:34:593
1503307991411,2cyclictest1465588-21kworker/u8:1+events_unbound11:20:153
1503307991411,2cyclictest1465588-21kworker/u8:1+events_unbound09:00:193
1503307991411,2cyclictest0-21swapper/309:25:003
1503307991411,1cyclictest0-21swapper/310:20:003
1503307991410,3cyclictest1768788-21kworker/u8:0+flush-259:011:45:123
1503307991410,3cyclictest1591167-21kworker/u8:0+events_unbound08:40:133
1503307991410,3cyclictest1529357-21kworker/u8:3+events_unbound07:55:243
1503307991410,3cyclictest1465588-21kworker/u8:1+events_unbound10:25:193
1503305991412,2cyclictest1758439-21kworker/u8:2+events_unbound12:00:022
1503300991410,3cyclictest1529357-21kworker/u8:3+events_unbound08:15:231
150330099140,8cyclictest335557-21systemd-journal10:25:001
150329799149,1cyclictest191rcu_preempt12:10:190
150329799146,1cyclictest191rcu_preempt10:30:100
1503297991412,1cyclictest60350irq/132-enp0s29f1:rx-010:15:150
150330799139,3cyclictest1768788-21kworker/u8:0+events_unbound11:25:243
150330799139,3cyclictest1465588-21kworker/u8:1+flush-259:010:35:163
150330799139,3cyclictest1465588-21kworker/u8:1+flush-259:010:35:163
1503307991310,2cyclictest1690483-21kworker/u8:0+flush-259:011:00:183
150330599132,2cyclictest1544926-21apt-get07:50:122
150330099139,3cyclictest1591167-21kworker/u8:0+flush-259:008:40:241
150330099139,3cyclictest1570706-21kworker/u8:2+flush-259:008:25:151
1503300991310,2cyclictest1529357-21kworker/u8:3+events_unbound08:05:191
150330799129,1cyclictest0-21swapper/309:10:133
150330799128,3cyclictest1633152-21kworker/u8:0+events_unbound09:19:023
150330099129,2cyclictest1591167-21kworker/u8:0+flush-259:008:55:241
150330099129,2cyclictest0-21swapper/110:05:001
150330099128,3cyclictest1570706-21kworker/u8:2+flush-259:008:50:201
150330099120,5cyclictest1632911-21sh09:15:001
150330799118,2cyclictest1836174-21cpuspeed_turbos12:30:143
150330799117,3cyclictest1539478-21kworker/u8:0+events_unbound07:54:003
150330799117,3cyclictest1465588-21kworker/u8:1+events_unbound09:55:153
150330099118,2cyclictest1835854-21kworker/u8:2+events_unbound12:30:161
150330099116,4cyclictest1534550-21apt-get07:40:131
150330099115,4cyclictest1784527-21seq11:40:141
150330099115,4cyclictest1607100-21latency_hist08:50:011
150330099107,2cyclictest1789847-21fschecks_count11:45:131
15033009996,2cyclictest1580829-21cron08:25:001
15033009994,4cyclictest1778106-21grep11:30:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional