You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 04:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri Dec 12, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1246661994846,1cyclictest1489591-21fwupd23:04:181
1246660994341,1cyclictest1391382-21kworker/0:1+pm23:04:180
1246663994238,3cyclictest1448659-21kworker/u8:1+flush-259:023:25:012
1246661994136,3cyclictest1412404-21latency_hist21:50:001
1246670993933,4cyclictest1350090-21latency_hist20:50:013
1246660993834,3cyclictest1546664-21kworker/u8:2+flush-259:000:00:010
1246670993733,3cyclictest1198760-21kworker/u8:2+events_unbound19:20:183
1246661993733,3cyclictest1350319-21kworker/u8:3+flush-259:021:10:001
1246661993628,5cyclictest2698871-21systemd-journal19:17:071
1246670993532,2cyclictest1557244-21kworker/u8:2+events_unbound00:35:023
1246670993532,2cyclictest1334902-21kworker/u8:0+events_unbound20:40:143
1246670993529,4cyclictest1402339-21/usr/sbin/munin21:40:173
1246660993431,2cyclictest1256942-21kworker/u8:0+flush-259:019:45:010
1246661993328,4cyclictest1448659-21kworker/u8:1+flush-259:023:10:011
1246670993229,2cyclictest1448659-21kworker/u8:1+events_unbound22:33:023
1246670993229,2cyclictest1198760-21kworker/u8:2+events_unbound19:28:123
1246663993227,3cyclictest1262724-21/usr/sbin/munin19:25:142
1246660993230,1cyclictest1572963-21kworker/u8:4+events_unbound00:34:590
1246670993128,2cyclictest1369739-21kworker/u8:0+events_unbound21:10:243
1246670993027,2cyclictest1448659-21kworker/u8:1+events_unbound23:34:203
1246670993027,2cyclictest1350319-21kworker/u8:3+events_unbound21:07:463
1246670992926,2cyclictest1469270-21kworker/u8:3+events_unbound23:04:183
1246660992926,2cyclictest1345189-21kworker/u8:2+flush-259:020:50:010
1246670992826,2cyclictest1572963-21kworker/u8:4+events_unbound00:31:213
1246670992826,2cyclictest1469270-21kworker/u8:3+events_unbound22:53:173
1246670992826,1cyclictest1448659-21kworker/u8:1+events_unbound00:15:173
1246670992825,2cyclictest1469270-21kworker/u8:3+events_unbound23:27:193
1246670992825,2cyclictest1448659-21kworker/u8:1+events_unbound00:07:183
1246670992824,2cyclictest1293387-21kworker/u8:1+events_unbound20:50:303
1246663992824,3cyclictest1369739-21kworker/u8:0+flush-259:022:15:192
1246661992822,4cyclictest1262057-21latency_hist19:25:011
1246660992825,2cyclictest1293387-21kworker/u8:1+flush-259:021:50:290
1246670992725,2cyclictest1329506-21kworker/u8:4+events_unbound20:30:243
1246670992724,2cyclictest1521045-21kworker/u8:0+events_unbound23:52:403
1246670992720,4cyclictest2698871-21systemd-journal22:25:143
1246670992623,2cyclictest1469270-21kworker/u8:3+events_unbound22:59:573
1246670992623,2cyclictest1293387-21kworker/u8:1+events_unbound21:55:283
1246661992620,4cyclictest1293633-21apt-get19:55:121
1246661992618,5cyclictest1505161-21latency_hist23:20:011
1246660992621,4cyclictest1381009-21latency_hist21:20:010
1246670992520,2cyclictest1557244-21kworker/u8:2+events_unbound00:25:183
1246670992518,5cyclictest1303667-21latency_hist20:05:003
1246663992522,2cyclictest1469270-21kworker/u8:3+events_unbound23:04:162
1246663992521,3cyclictest1567518-21kworker/u8:0+flush-259:000:39:592
1246663992518,5cyclictest1319132-21latency_hist20:20:002
1246660992519,4cyclictest2698871-21systemd-journal20:00:000
1246670992421,2cyclictest1521045-21kworker/u8:0+events_unbound23:49:573
1246670992421,2cyclictest1468824-21kworker/u8:0+events_unbound22:43:203
1246670992421,2cyclictest1369739-21kworker/u8:0+events_unbound22:06:113
1246670992420,3cyclictest1293387-21kworker/u8:1+events_unbound20:14:563
1246663992421,2cyclictest1567518-21kworker/u8:0+flush-259:000:20:172
1246661992420,3cyclictest1334902-21kworker/u8:0+flush-259:020:35:201
1246661992419,3cyclictest1515637-21base6423:30:011
1246660992418,5cyclictest1474203-21latency_hist22:50:010
1246660992418,5cyclictest1255991-21ntpq19:15:210
1246670992320,2cyclictest1469270-21kworker/u8:3+events_unbound23:42:513
1246670992317,4cyclictest2698871-21systemd-journal19:45:103
1246670992316,5cyclictest2698871-21systemd-journal21:50:003
1246663992318,4cyclictest2698871-21systemd-journal21:35:012
1246661992316,5cyclictest2698871-21systemd-journal19:35:001
1246660992320,2cyclictest1432751-21kworker/u8:1+flush-259:022:09:590
1246660992317,5cyclictest1515472-21latency_hist23:30:010
1246660992317,4cyclictest1267595-21latency_hist19:30:000
1246661992216,4cyclictest1386843-21apt-get21:25:131
1246661992215,5cyclictest1360413-21latency_hist21:00:011
1246670992119,2cyclictest1557244-21kworker/u8:2+events_unbound00:11:183
1246670992118,2cyclictest1469270-21kworker/u8:3+events_unbound00:04:563
1246670992118,2cyclictest1293387-21kworker/u8:1+events_unbound19:57:123
1246663992117,3cyclictest1293387-21kworker/u8:1+flush-259:020:00:152
1246661992115,4cyclictest1531569-21/usr/sbin/munin23:45:151
1246660992118,2cyclictest1391990-21kworker/u8:2+flush-259:021:30:170
1246670992018,2cyclictest1350319-21kworker/u8:3+events_unbound21:02:493
1246670992017,2cyclictest1469270-21kworker/u8:3+events_unbound23:19:183
1246670992017,2cyclictest1385342-21kworker/u8:3+events_unbound21:21:123
1246670992017,2cyclictest1293387-21kworker/u8:1+events_unbound21:30:023
1246670992017,2cyclictest1293387-21kworker/u8:1+events_unbound20:29:113
1246670992017,2cyclictest1293387-21kworker/u8:1+events_unbound20:07:333
1246670992015,3cyclictest1469270-21kworker/u8:3+flush-259:023:20:203
1246663992017,2cyclictest1399307-21kworker/u8:4+flush-259:021:45:172
1246663992017,2cyclictest1385342-21kworker/u8:3+events_unbound21:35:022
1246661992014,4cyclictest1562641-21/usr/sbin/munin00:15:171
1246661992014,4cyclictest1402094-21latency_hist21:40:011
1246660992017,2cyclictest1334902-21kworker/u8:0+flush-259:020:40:000
1246660992016,3cyclictest1546846-21kworker/u8:5+flush-259:000:10:230
1246660992016,3cyclictest1448659-21kworker/u8:1+flush-259:023:00:000
1246670991917,1cyclictest1432751-21kworker/u8:1+events_unbound22:12:583
1246670991916,2cyclictest1469270-21kworker/u8:3+events_unbound00:21:373
1246670991916,2cyclictest1293387-21kworker/u8:1+events_unbound21:51:123
1246663991916,2cyclictest3402096-21kworker/u8:1+events_unbound19:15:162
1246663991916,2cyclictest1557244-21kworker/u8:2+flush-259:000:10:312
1246663991916,2cyclictest1469270-21kworker/u8:3+flush-259:023:20:012
1246661991913,4cyclictest2698871-21systemd-journal21:05:011
1246660991916,2cyclictest1293366-21latency_hist19:55:000
1246660991915,3cyclictest1552309-21apt-get00:05:140
1246670991815,2cyclictest1453799-21kworker/u8:4+events_unbound22:39:553
1246670991815,2cyclictest1334902-21kworker/u8:0+events_unbound20:57:423
1246670991815,2cyclictest1256942-21kworker/u8:0+events_unbound19:34:113
1246663991815,2cyclictest1360642-21kworker/u8:2+flush-259:021:20:012
1246663991815,2cyclictest1334902-21kworker/u8:0+flush-259:020:40:262
1246663991813,4cyclictest1329729-21/usr/sbin/munin20:30:152
1246661991812,4cyclictest2698871-21systemd-journal20:30:001
1246661991811,5cyclictest1572738-21latency_hist00:25:011
1246660991816,1cyclictest0-21swapper/023:15:000
1246660991815,2cyclictest1437952-21kworker/u8:2+events_unbound22:50:190
1246660991815,2cyclictest1385342-21kworker/u8:3+flush-259:021:40:000
124667099175,3cyclictest50-21ksoftirqd/321:30:003
1246670991715,2cyclictest1267822-21kworker/u8:3+events_unbound20:19:583
1246670991715,1cyclictest481rcuc/319:40:253
1246670991714,2cyclictest1469270-21kworker/u8:3+events_unbound23:14:173
1246670991714,2cyclictest1437952-21kworker/u8:2+events_unbound22:23:573
1246670991714,2cyclictest1334902-21kworker/u8:0+events_unbound20:39:123
1246670991714,2cyclictest1267822-21kworker/u8:3+events_unbound20:23:103
1246670991714,2cyclictest1267822-21kworker/u8:3+events_unbound20:23:103
1246670991714,2cyclictest1198760-21kworker/u8:2+events_unbound19:16:573
1246670991712,1cyclictest191rcu_preempt22:00:153
124666399176,5cyclictest1552047-21munin-run00:05:002
1246663991715,1cyclictest1370691-21cron21:10:002
1246663991714,2cyclictest1521010-21idleruntime-cro23:35:012
1246663991714,2cyclictest0-21swapper/219:40:002
1246663991713,3cyclictest1437229-21ntp_kernel_pll_22:10:222
1246663991713,3cyclictest1386266-21gpgv21:25:002
1246663991713,3cyclictest1293387-21kworker/u8:1+flush-259:020:45:272
1246661991711,4cyclictest1324802-21diskstats20:25:171
1246660991714,2cyclictest60650irq/133-enp0s29f1:rx-020:50:250
1246660991714,2cyclictest1521045-21kworker/u8:0+flush-259:023:40:230
1246660991714,2cyclictest1399307-21kworker/u8:4+flush-259:021:45:010
1246660991713,3cyclictest1369739-21kworker/u8:0+flush-259:022:25:150
1246660991713,3cyclictest1369739-21kworker/u8:0+flush-259:021:20:310
1246670991613,2cyclictest1521045-21kworker/u8:0+events_unbound23:55:073
1246670991613,2cyclictest1521045-21kworker/u8:0+events_unbound23:35:563
1246670991613,2cyclictest1369739-21kworker/u8:0+events_unbound22:19:163
124666399165,5cyclictest1339819-21munin-run20:40:012
1246663991614,1cyclictest1469270-21kworker/u8:3+events_unbound23:45:192
1246663991613,2cyclictest1546846-21kworker/u8:5+events_unbound00:05:192
1246663991613,2cyclictest1469270-21kworker/u8:3+flush-259:022:45:152
1246663991613,2cyclictest1293387-21kworker/u8:1+flush-259:021:50:262
1246663991613,2cyclictest1293387-21kworker/u8:1+flush-259:021:25:182
1246663991612,3cyclictest1448659-21kworker/u8:1+flush-259:022:30:002
1246663991610,4cyclictest2698871-21systemd-journal20:25:002
1246663991610,4cyclictest2698871-21systemd-journal20:25:002
124666199169,5cyclictest1375857-21latency_hist21:15:011
1246661991613,2cyclictest1340077-21apt-get20:40:111
1246661991612,3cyclictest1469270-21kworker/u8:3+flush-259:022:55:011
1246661991612,3cyclictest1417817-21apt-get21:55:171
124666099165,4cyclictest2698871-21systemd-journal00:19:590
1246660991613,2cyclictest61450irq/134-enp0s29f1:tx-022:20:160
1246660991613,2cyclictest61450irq/134-enp0s29f1:tx-020:00:240
1246660991613,2cyclictest61450irq/134-enp0s29f1:tx-019:10:170
1246660991613,2cyclictest60650irq/133-enp0s29f1:rx-022:00:220
1246660991613,2cyclictest1448659-21kworker/u8:1+events_unbound23:05:170
1246660991613,2cyclictest1308789-21turbostat20:10:000
1246660991612,3cyclictest3002-21cron00:40:000
1246660991612,3cyclictest1469270-21kworker/u8:3+events_unbound23:20:260
1246660991611,4cyclictest1577908-21latency_hist00:30:010
1246660991610,5cyclictest1571871-21ntpq00:20:230
1246660991610,4cyclictest2698871-21systemd-journal20:13:100
1246660991610,4cyclictest1262059-21apt-get19:25:010
124667099156,1cyclictest0-21swapper/319:10:173
124667099153,7cyclictest50-21ksoftirqd/319:55:003
124667099153,2cyclictest0-21swapper/323:05:143
1246670991512,2cyclictest1256942-21kworker/u8:0+events_unbound19:35:273
124667099150,4cyclictest50-21ksoftirqd/321:35:203
124666399159,5cyclictest1546819-21latency_hist00:00:012
1246663991513,1cyclictest0-21swapper/222:05:002
1246663991512,1cyclictest0-21swapper/219:35:002
1246661991511,3cyclictest1399307-21kworker/u8:4+flush-259:022:00:171
1246661991511,2cyclictest0-21swapper/123:40:001
1246661991510,3cyclictest2698871-21systemd-journal22:32:141
1246660991514,1cyclictest60650irq/133-enp0s29f1:rx-021:47:210
1246660991513,2cyclictest1469270-21kworker/u8:3+flush-259:023:30:150
1246660991513,1cyclictest60650irq/133-enp0s29f1:rx-023:45:160
1246660991512,2cyclictest61450irq/134-enp0s29f1:tx-021:00:180
1246660991512,2cyclictest60650irq/133-enp0s29f1:rx-022:14:160
1246660991512,2cyclictest60650irq/133-enp0s29f1:rx-021:25:200
1246660991512,2cyclictest1521712-21irqcore23:35:170
1246660991512,2cyclictest1437952-21kworker/u8:2+events_unbound22:40:210
1246660991512,2cyclictest1334203-21unixbench_multi20:30:260
1246660991512,2cyclictest1272724-21cron19:35:000
1246660991511,3cyclictest2698871-21systemd-journal19:39:100
1246660991511,3cyclictest1319409-21apt-get20:20:140
1246660991511,3cyclictest1319409-21apt-get20:20:140
1246660991510,3cyclictest1399307-21kworker/u8:4+events_unbound21:59:110
124667099143,2cyclictest0-21swapper/322:45:113
1246663991412,2cyclictest1293387-21kworker/u8:1+flush-259:020:10:152
1246663991412,1cyclictest0-21swapper/223:30:002
1246663991411,2cyclictest1541199-21unixbench_multi23:50:252
1246663991411,2cyclictest1521045-21kworker/u8:0+flush-259:023:40:152
1246663991411,2cyclictest1469270-21kworker/u8:3+events_unbound23:10:232
1246663991411,2cyclictest1283087-21kworker/u8:2+events_unbound19:50:162
1246663991410,3cyclictest3000061-21in:imuxsock19:25:012
1246663991410,3cyclictest1474440-21/usr/sbin/munin22:50:252
124666199149,4cyclictest1521045-21kworker/u8:0+flush-259:023:55:281
1246661991411,2cyclictest1567518-21kworker/u8:0+flush-259:000:35:261
1246661991410,3cyclictest1417095-21unixbench_multi21:50:291
1246661991410,3cyclictest1267822-21kworker/u8:3+flush-259:019:40:251
1246660991412,2cyclictest60650irq/133-enp0s29f1:rx-020:16:340
1246660991412,1cyclictest60650irq/133-enp0s29f1:rx-020:59:090
1246660991412,1cyclictest60650irq/133-enp0s29f1:rx-020:25:230
1246660991411,2cyclictest61450irq/134-enp0s29f1:tx-000:00:150
1246660991411,2cyclictest1293387-21kworker/u8:1+events_unbound21:05:200
1246660991410,3cyclictest1453843-21apt-get22:30:150
1246660991410,3cyclictest1448659-21kworker/u8:1+flush-259:023:15:220
1246663991310,2cyclictest1563082-21tr00:15:202
1246663991310,2cyclictest1459444-21irqcore22:35:172
1246663991310,2cyclictest1422914-21kworker/u8:3+events_unbound22:05:192
1246663991310,2cyclictest1287301-21ntp_kernel_err19:45:202
1246663991310,2cyclictest1267822-21kworker/u8:3+events_unbound19:45:002
1246661991310,2cyclictest0-21swapper/120:15:161
1246661991310,2cyclictest0-21swapper/100:34:591
1246660991311,1cyclictest60650irq/133-enp0s29f1:rx-022:15:180
1246660991310,2cyclictest60650irq/133-enp0s29f1:rx-020:40:250
124666399129,2cyclictest1578437-21fschecks_time00:30:182
124666399129,2cyclictest1402539-21fschecks_count21:40:172
124666399129,2cyclictest1355666-21cpuspeed_turbos20:55:132
124666399128,3cyclictest1267822-21kworker/u8:3+flush-259:020:25:262
124666399128,3cyclictest1198760-21kworker/u8:2+flush-259:019:10:122
124666199129,2cyclictest1370925-21kworker/u8:4+flush-259:021:15:191
124666199129,2cyclictest0-21swapper/123:10:251
124666199128,3cyclictest1437952-21kworker/u8:2+flush-259:022:45:241
124666199128,3cyclictest1303935-21apt-get20:05:131
124666199126,4cyclictest3000063-21rs:main1
1246661991210,1cyclictest0-21swapper/123:55:001
124666099128,3cyclictest1448659-21kworker/u8:1+events_unbound22:35:220
124666399118,2cyclictest1557244-21kworker/u8:2+flush-259:000:25:312
124666399117,3cyclictest0-21swapper/220:10:002
124666199119,1cyclictest0-21swapper/122:40:191
124666199119,1cyclictest0-21swapper/119:10:191
124666199118,2cyclictest1561933-21unixbench_multi00:10:291
124666199118,2cyclictest1406760-21unixbench_multi21:40:291
124666199118,2cyclictest0-21swapper/123:25:001
124666199118,2cyclictest0-21swapper/100:05:181
124666399105,4cyclictest1422867-21cat22:00:002
124666199107,2cyclictest1459084-21cpuspeed_turbos22:35:131
124666199107,2cyclictest1381348-21cpuspeed_turbos21:20:161
124666199107,2cyclictest1288910-21cut19:50:171
12466639996,2cyclictest1494427-21unixbench_singl23:05:272
12466619994,4cyclictest2698871-21systemd-journal23:45:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional