You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 00:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Tue Mar 31, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1334662994134,5cyclictest1668285-21cat12:30:011
1334657994035,4cyclictest1548536-21apt-get10:35:100
1334668993936,2cyclictest1418283-21gpgv08:30:023
1334668993629,5cyclictest252-21systemd-journal07:20:003
1334665993632,3cyclictest252-21systemd-journal12:09:452
1334662993630,4cyclictest1610558-21latency_hist11:35:001
1334657993531,3cyclictest1548318-21kworker/u8:0+flush-259:011:15:140
1334668993327,4cyclictest252-21systemd-journal07:45:003
1334662993326,5cyclictest1401217-21ntpq08:10:211
1334657993328,4cyclictest1626058-21kworker/u8:2+flush-259:012:20:160
1334657993326,5cyclictest1443253-21ntpq08:50:190
1334657993230,1cyclictest1392043-21fwupd08:05:090
1334665993128,2cyclictest1491143-21gpgv09:40:012
1334665993128,2cyclictest1491143-21gpgv09:40:002
1334665993126,4cyclictest252-21systemd-journal12:40:002
1334662993018,3cyclictest1475387-21apt-get09:25:121
1334665992923,4cyclictest1407325-21latency_hist08:20:012
1334657992923,4cyclictest1298541-21kworker/u8:0+flush-259:007:35:170
1334668992723,3cyclictest1578894-21apt-get11:01:203
1334662992720,5cyclictest252-21systemd-journal11:25:001
1334657992724,2cyclictest1381163-21kworker/u8:1+events_unbound08:35:110
1334657992722,4cyclictest1339769-21kworker/u8:2+flush-259:007:25:000
1334657992722,3cyclictest1542855-21kworker/u8:1+flush-259:011:00:220
133465799271,24cyclictest1490627-21munin-run09:40:010
1334668992622,3cyclictest1355500-21apt-get07:30:123
1334665992620,4cyclictest1641431-21latency_hist12:05:012
1334662992622,3cyclictest1626058-21kworker/u8:2+flush-259:012:25:231
1334657992624,1cyclictest1381163-21kworker/u8:1+flush-259:010:15:010
1334657992620,4cyclictest1359550-21ntpq07:30:230
1334657992620,4cyclictest1334583-21latency_hist07:10:000
1334668992519,4cyclictest1548269-21latency_hist10:35:013
1334668992518,5cyclictest252-21systemd-journal12:15:173
1334665992520,4cyclictest1589537-21kworker/u8:3+flush-259:011:30:102
1334662992521,3cyclictest1589537-21kworker/u8:3+flush-259:011:45:241
1334662992520,3cyclictest509-21rs:main1
1334662992519,4cyclictest252-21systemd-journal10:30:001
1334657992521,3cyclictest1381163-21kworker/u8:1+flush-259:008:55:270
1334657992521,3cyclictest1381163-21kworker/u8:1+events_unbound09:50:010
1334657992518,5cyclictest252-21systemd-journal10:34:090
1334668992421,2cyclictest1495129-21kworker/u8:0+flush-259:010:05:163
1334665992422,1cyclictest1381163-21kworker/u8:1+flush-259:008:20:162
1334665992420,3cyclictest252-21systemd-journal07:35:032
1334665992420,3cyclictest1626058-21kworker/u8:2+flush-259:012:20:212
1334665992419,4cyclictest1458728-21ntpq09:05:222
1334665992418,5cyclictest509-21rs:main2
1334662992418,4cyclictest1340015-21apt-get07:15:131
1334662992417,4cyclictest1386631-21latency_hist08:00:011
1334668992319,3cyclictest1558814-21apt-get10:45:123
1334668992317,4cyclictest1402136-21latency_hist08:15:003
1334665992319,3cyclictest1354931-21kworker/u8:3+flush-259:007:40:252
1334657992319,3cyclictest1542855-21kworker/u8:1+flush-259:010:50:210
1334657992319,3cyclictest1517127-21kworker/u8:2+flush-259:010:20:210
1334657992319,3cyclictest1371187-21kworker/u8:0+flush-259:007:45:210
1334657992317,5cyclictest1428789-21apt-get08:40:120
1334657992317,4cyclictest1381163-21kworker/u8:1+flush-259:007:55:000
1334668992217,4cyclictest1579482-21/usr/sbin/munin11:05:203
1334665992218,3cyclictest1646465-21kworker/u8:1+flush-259:012:30:202
1334665992218,3cyclictest1626058-21kworker/u8:2+flush-259:012:25:162
1334665992218,3cyclictest1542855-21kworker/u8:1+flush-259:011:00:122
1334665992216,4cyclictest1469972-21latency_hist09:20:002
1334657992219,2cyclictest1381163-21kworker/u8:1+flush-259:008:25:270
1334657992219,2cyclictest1360428-21kworker/u8:2+events_unbound08:20:220
1334657992218,3cyclictest1589537-21kworker/u8:3+flush-259:011:55:150
1334657992217,3cyclictest1532390-21gpgv10:20:010
1334657992216,4cyclictest252-21systemd-journal07:41:090
1334657992215,5cyclictest1604503-21ntpq11:25:210
133465799220,20cyclictest1-21systemd10:41:090
1334668992114,5cyclictest252-21systemd-journal09:40:003
1334665992115,4cyclictest252-21systemd-journal07:54:092
1334662992115,4cyclictest509-21rs:main1
1334657992117,3cyclictest1646465-21kworker/u8:1+events_unbound12:10:130
1334657992117,3cyclictest1542855-21kworker/u8:1+flush-259:011:30:230
1334657992117,3cyclictest1381163-21kworker/u8:1+flush-259:007:56:410
1334657992117,3cyclictest1381163-21kworker/u8:1+events_unbound09:15:180
1334668992017,2cyclictest1364971-21kworker/u8:4+flush-259:007:50:003
1334668992016,3cyclictest1517127-21kworker/u8:2+events_unbound10:20:143
1334668992016,3cyclictest1392078-21apt-get08:05:123
133466899201,18cyclictest1-21systemd09:19:093
1334662992016,3cyclictest1381163-21kworker/u8:1+flush-259:010:10:261
1334662992015,4cyclictest1501624-21apt-get09:50:111
1334662992015,4cyclictest1329468-21kworker/u8:1+flush-259:007:25:261
1334662992015,3cyclictest1532104-21kworker/u8:3+flush-259:010:34:591
1334662992015,3cyclictest1402409-21apt-get08:15:131
1334662992013,5cyclictest252-21systemd-journal07:39:081
1334657992017,2cyclictest1626058-21kworker/u8:2+flush-259:012:25:170
1334657992016,3cyclictest1646465-21kworker/u8:1+events_unbound12:15:150
1334657992016,3cyclictest1517127-21kworker/u8:2+flush-259:010:25:220
1334657992014,4cyclictest1-21systemd09:26:090
1334668991916,2cyclictest1626058-21kworker/u8:2+events_unbound12:20:143
133466899190,17cyclictest1-21systemd09:00:003
1334665991916,2cyclictest1438961-21cron08:50:012
1334665991916,2cyclictest1417724-21sh08:30:012
1334665991913,4cyclictest252-21systemd-journal11:38:092
1334665991913,4cyclictest1444138-21latency_hist08:54:592
1334657991916,2cyclictest1339769-21kworker/u8:2+events_unbound07:25:090
1334657991915,3cyclictest1589537-21kworker/u8:3+events_unbound11:39:100
1334657991915,3cyclictest1381163-21kworker/u8:1+events_unbound09:55:150
1334657991915,3cyclictest1381163-21kworker/u8:1+events_unbound09:30:190
1334657991915,3cyclictest1360428-21kworker/u8:2+events_unbound09:00:160
1334657991914,4cyclictest1542855-21kworker/u8:1+flush-259:010:59:390
1334657991912,5cyclictest1631149-21latency_hist11:55:000
1334668991814,3cyclictest1568869-21dump-pmu-power10:55:013
1334665991813,3cyclictest252-21systemd-journal12:03:172
1334662991814,3cyclictest1495129-21kworker/u8:0+flush-259:009:55:211
1334662991813,4cyclictest1646591-21latency_hist12:10:011
1334662991812,4cyclictest1594652-21latency_hist11:20:001
1334662991811,5cyclictest252-21systemd-journal10:06:091
1334657991814,3cyclictest1381163-21kworker/u8:1+events_unbound09:10:190
1334657991812,4cyclictest1438970-21latency_hist08:50:010
1334668991714,2cyclictest1491681-21irqcore09:40:183
1334668991714,2cyclictest1491681-21irqcore09:40:173
1334668991714,2cyclictest1475104-21cron09:24:593
1334668991714,2cyclictest1360428-21kworker/u8:2+events_unbound09:05:243
1334668991713,3cyclictest1495129-21kworker/u8:0+flush-259:009:50:183
1334665991713,2cyclictest1480959-21irqcore09:30:142
1334665991712,3cyclictest1495129-21kworker/u8:0+flush-259:010:00:092
1334662991714,2cyclictest1589537-21kworker/u8:3+flush-259:011:45:001
1334662991713,3cyclictest1610826-21apt-get11:35:141
1334657991713,3cyclictest1646465-21kworker/u8:1+events_unbound12:30:130
1334657991713,3cyclictest1542855-21kworker/u8:1+events_unbound11:10:160
1334657991713,3cyclictest1495129-21kworker/u8:0+events_unbound10:00:140
1334657991713,3cyclictest1381163-21kworker/u8:1+events_unbound09:05:210
1334668991613,2cyclictest1646465-21kworker/u8:1+events_unbound12:30:173
1334668991612,3cyclictest1449302-21kworker/u8:0+events_unbound09:30:133
1334668991612,3cyclictest1381163-21kworker/u8:1+flush-259:008:25:153
133466899161,13cyclictest1501382-21munin-run09:50:013
1334665991614,1cyclictest1647871-21kthreadcore12:10:192
1334665991614,1cyclictest0-21swapper/208:10:002
1334665991613,2cyclictest1506538-21idleruntime-cro09:54:592
1334665991610,3cyclictest252-21systemd-journal10:35:092
1334662991612,3cyclictest1542855-21kworker/u8:1+flush-259:010:50:161
1334662991612,3cyclictest1542855-21kworker/u8:1+flush-259:010:45:241
1334662991611,4cyclictest252-21systemd-journal11:29:591
1334662991611,4cyclictest1574299-21apt-get11:00:111
1334662991611,3cyclictest252-21systemd-journal09:03:091
1334657991614,1cyclictest60350irq/132-enp0s29f1:rx-012:35:460
1334657991613,2cyclictest61150irq/133-enp0s29f1:tx-009:20:170
1334657991613,2cyclictest1631379-21kworker/u8:4+events_unbound12:05:170
1334668991513,1cyclictest0-21swapper/312:10:003
1334668991512,2cyclictest1542855-21kworker/u8:1+flush-259:011:35:153
1334668991512,2cyclictest1532361-21idleruntime-cro10:20:003
1334668991511,3cyclictest1360428-21kworker/u8:2+flush-259:009:05:003
133466599159,4cyclictest252-21systemd-journal09:58:102
133466599158,5cyclictest1567985-21ntpq10:50:202
1334665991511,3cyclictest1449302-21kworker/u8:0+flush-259:009:20:252
1334662991513,1cyclictest1584367-21latency_hist11:10:001
1334662991511,3cyclictest1626058-21kworker/u8:2+flush-259:012:20:001
1334662991511,3cyclictest1589537-21kworker/u8:3+flush-259:011:55:001
1334657991514,1cyclictest60350irq/132-enp0s29f1:rx-011:49:490
1334657991513,2cyclictest61150irq/133-enp0s29f1:tx-012:00:190
1334657991513,2cyclictest61150irq/133-enp0s29f1:tx-012:00:190
1334657991513,2cyclictest60350irq/132-enp0s29f1:rx-009:53:180
1334657991513,2cyclictest60350irq/132-enp0s29f1:rx-008:13:070
1334657991512,2cyclictest60350irq/132-enp0s29f1:rx-007:10:110
1334657991512,2cyclictest1542855-21kworker/u8:1+events_unbound10:45:190
1334657991511,3cyclictest1542855-21kworker/u8:1+events_unbound11:05:220
133466899148,4cyclictest1599351-21ntpq11:20:213
1334668991411,2cyclictest500-21systemd-logind10:15:013
1334668991411,2cyclictest1651751-21latency_hist12:15:013
1334668991411,2cyclictest1428103-21unixbench_singl08:35:243
1334668991411,2cyclictest1412543-21idleruntime-cro08:25:013
1334668991410,3cyclictest1542855-21kworker/u8:1+flush-259:010:40:173
1334665991410,2cyclictest1340430-21irqcore07:15:172
133466299148,4cyclictest1496178-21latency_hist09:45:011
1334662991411,2cyclictest1542855-21kworker/u8:1+flush-259:011:10:191
1334657991411,2cyclictest60350irq/132-enp0s29f1:rx-008:00:110
1334657991411,2cyclictest60350irq/132-enp0s29f1:rx-007:15:140
1334657991410,3cyclictest1610594-21kworker/u8:0+events_unbound11:44:430
1334657991410,3cyclictest1484612-21kworker/u8:3+events_unbound09:40:100
1334657991410,3cyclictest1484612-21kworker/u8:3+events_unbound09:40:090
133466899139,3cyclictest1360428-21kworker/u8:2+flush-259:008:40:243
133466899138,3cyclictest252-21systemd-journal11:54:433
1334668991310,2cyclictest1589503-21idleruntime-cro11:15:003
1334668991310,2cyclictest1462207-21kthreadcore09:10:173
1334668991310,2cyclictest1381163-21kworker/u8:1+events_unbound08:00:193
1334668991310,2cyclictest1345579-21irqcore07:20:153
1334668991310,2cyclictest1329468-21kworker/u8:1+flush-259:007:25:223
133466599139,3cyclictest1298541-21kworker/u8:0+flush-259:007:10:242
133466599132,2cyclictest13595652grep07:30:232
1334665991310,2cyclictest0-21swapper/208:30:192
1334662991311,1cyclictest1660902-21kthreadcore12:20:181
1334662991310,2cyclictest1647025-21fschecks_count12:10:161
133465799138,4cyclictest1495129-21kworker/u8:0+events_unbound10:05:200
1334657991310,2cyclictest60350irq/132-enp0s29f1:rx-011:20:010
133466899129,2cyclictest1592072-21sort11:15:173
133466899129,2cyclictest1542604-21unixbench_multi10:25:243
133466899129,2cyclictest0-21swapper/312:30:003
133466899129,2cyclictest0-21swapper/312:05:003
133466899129,2cyclictest0-21swapper/312:05:003
133466899128,3cyclictest1626058-21kworker/u8:2+flush-259:012:35:203
133466899126,4cyclictest490-21dbus-daemon08:00:003
1334668991210,1cyclictest0-21swapper/311:00:013
133466599129,2cyclictest1601506-21kthreadcore11:25:172
133466599129,2cyclictest0-21swapper/211:20:002
133466599129,1cyclictest0-21swapper/208:15:002
133466299129,2cyclictest1444525-21tr08:55:131
133466299129,2cyclictest1438053-21ntp_kernel_err08:45:211
133466299128,3cyclictest2971-21cron08:45:011
133466299127,4cyclictest1381163-21kworker/u8:1+flush-259:008:00:261
133466899119,1cyclictest0-21swapper/310:35:163
133466899118,2cyclictest1511228-21unixbench_singl09:55:253
133466899118,2cyclictest1479865-21unixbench_singl09:25:253
133466899118,2cyclictest1435057-21kthreadcore08:45:193
133466899118,2cyclictest1336239-21kthreadcore07:10:163
133466899115,4cyclictest252-21systemd-journal11:46:093
133466599118,2cyclictest1559012-21fschecks_count10:45:142
133466599118,2cyclictest1424607-21kthreadcore08:35:162
133466599118,2cyclictest1385730-21ntp_kernel_pll_07:55:202
133466599117,2cyclictest0-21swapper/208:55:252
133466599116,3cyclictest509-21rs:main2
133466599115,2cyclictest1532364-21apt-get10:20:002
133466299119,1cyclictest1412527-21cron08:25:001
133466299119,1cyclictest0-21swapper/110:35:111
133466299118,2cyclictest500-21systemd-logind07:45:001
133466299118,1cyclictest0-21swapper/109:15:011
133466299117,3cyclictest1532364-21apt-get10:20:021
133466599107,2cyclictest1376328-21latency_hist07:50:012
133466299104,4cyclictest1392043-21fwupd08:05:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional