You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 06:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Aug 01, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1426267994337,4cyclictest335557-21systemd-journal22:55:010
1426277994034,4cyclictest1441733-21latency_hist19:25:003
1426277994032,5cyclictest1733730-21latency_hist00:05:003
1426277993934,4cyclictest1665756-21kworker/u8:0+flush-259:023:15:003
1426270993935,3cyclictest1416221-21kworker/u8:1+events_unbound19:12:191
1426267993936,1cyclictest1-21systemd23:00:010
1426270993733,3cyclictest1447009-21gpgv19:30:001
1426270993732,3cyclictest1416221-21kworker/u8:1+flush-259:020:15:211
1426270993731,4cyclictest335557-21systemd-journal22:18:341
1426277993631,3cyclictest1446748-21kworker/u8:3+flush-259:019:55:003
1426270993632,3cyclictest1665756-21kworker/u8:0+events_unbound23:18:281
1426270993629,5cyclictest1732843-21ntpq00:00:201
1426270993532,2cyclictest1572392-21kworker/u8:2+flush-259:022:21:351
1426270993528,5cyclictest1572366-21latency_hist21:30:001
1426267993529,4cyclictest1525888-21latency_hist20:45:010
1426270993430,3cyclictest1707936-21kworker/u8:1+events_unbound00:20:241
1426270993430,3cyclictest1707936-21kworker/u8:1+events_unbound00:20:231
1426270993430,3cyclictest1510375-21kworker/u8:2+flush-259:020:35:001
1426270993429,4cyclictest1572392-21kworker/u8:2+flush-259:023:32:061
1426267993428,4cyclictest1562046-21latency_hist21:20:010
1426270993330,2cyclictest1614307-21kworker/u8:3+flush-259:022:30:201
1426270993330,2cyclictest1572392-21kworker/u8:2+events_unbound00:30:231
1426270993329,3cyclictest1452535-21kworker/u8:4+flush-259:020:05:001
1426270993325,5cyclictest1436561-21latency_hist19:20:001
1426273993226,4cyclictest1718214-21latency_hist23:50:002
1426273993225,5cyclictest1488740-21ntpq20:05:242
1426277993128,2cyclictest1504711-21kworker/u8:0+events_unbound20:35:193
1426273993126,3cyclictest509-21rs:main2
1426270993128,2cyclictest1572392-21kworker/u8:2+events_unbound23:23:351
1426270993128,2cyclictest1416221-21kworker/u8:1+events_unbound19:50:271
1426270993127,3cyclictest1520722-21kworker/u8:1+flush-259:021:10:161
1426270993127,3cyclictest1520722-21kworker/u8:1+events_unbound21:50:351
1426270993127,3cyclictest1416221-21kworker/u8:1+events_unbound19:30:201
1426267993127,3cyclictest1707936-21kworker/u8:1+flush-259:000:00:170
1426267993126,3cyclictest509-21rs:main0
1426270993027,2cyclictest1665756-21kworker/u8:0+events_unbound23:25:241
1426270993027,2cyclictest1572392-21kworker/u8:2+flush-259:023:35:171
1426270993026,3cyclictest1504711-21kworker/u8:0+events_unbound20:40:301
1426267993026,2cyclictest1562082-21kworker/u8:0+events_unbound21:30:250
1426267993023,5cyclictest1510353-21latency_hist20:30:010
1426270992926,2cyclictest1504711-21kworker/u8:0+flush-259:020:25:251
1426267992926,2cyclictest211rcuc/022:40:000
1426267992922,5cyclictest1685506-21ntpq23:15:220
1426267992922,5cyclictest1634724-21latency_hist22:30:010
1426277992823,3cyclictest1562307-21apt-get21:20:113
1426277992822,4cyclictest335557-21systemd-journal00:39:533
1426273992824,3cyclictest1696978-21store23:30:022
1426273992823,3cyclictest1446895-21latency_hist19:30:002
1426273992821,5cyclictest1582680-21latency_hist21:40:002
1426270992825,2cyclictest1655445-21kworker/u8:3+flush-259:022:50:201
1426270992824,3cyclictest1546765-21apt-get21:05:131
1426277992720,4cyclictest335557-21systemd-journal20:31:293
1426277992716,10cyclictest1603343-21apt-get22:00:013
1426277992716,10cyclictest1603343-21apt-get22:00:003
1426273992720,5cyclictest1608075-21ntpq22:00:242
1426270992724,2cyclictest1536183-21kworker/u8:3+events_unbound20:55:141
1426270992723,3cyclictest1520722-21kworker/u8:1+events_unbound22:41:361
1426270992722,4cyclictest1572392-21kworker/u8:2+events_unbound23:05:241
1426267992723,3cyclictest1707936-21kworker/u8:1+flush-259:023:50:000
1426267992720,5cyclictest1473680-21latency_hist19:55:000
1426277992619,4cyclictest1734383-21latency_hist00:10:003
1426270992623,2cyclictest1593029-21kworker/u8:0+events_unbound22:07:341
1426270992623,2cyclictest1458326-21kworker/u8:0+events_unbound19:45:191
1426267992618,6cyclictest335557-21systemd-journal22:11:340
1426273992522,2cyclictest1536183-21kworker/u8:3+events_unbound21:05:012
1426273992521,3cyclictest1562082-21kworker/u8:0+flush-259:021:20:212
1426270992521,3cyclictest1614307-21kworker/u8:3+events_unbound22:27:341
1426270992521,3cyclictest1520722-21kworker/u8:1+flush-259:021:30:331
1426270992521,3cyclictest1458326-21kworker/u8:0+events_unbound19:43:181
1426270992521,2cyclictest1707936-21kworker/u8:1+events_unbound23:45:231
1426273992418,4cyclictest1765846-21latency_hist00:40:002
1426270992421,2cyclictest1520722-21kworker/u8:1+events_unbound21:56:431
1426270992421,2cyclictest1520722-21kworker/u8:1+events_unbound21:56:431
1426270992419,3cyclictest1489931-21apt-get20:10:181
1426277992319,3cyclictest1572392-21kworker/u8:2+flush-259:022:20:003
1426277992318,4cyclictest1572392-21kworker/u8:2+flush-259:022:25:013
1426270992319,3cyclictest1707936-21kworker/u8:1+flush-259:000:10:201
1426267992320,2cyclictest1510375-21kworker/u8:2+flush-259:020:40:000
1426267992320,2cyclictest1446748-21kworker/u8:3+flush-259:020:05:200
1426267992319,3cyclictest1707936-21kworker/u8:1+flush-259:000:15:240
1426267992319,2cyclictest1696989-21latency_hist23:30:010
142627799220,10cyclictest1670190-21/usr/sbin/munin23:00:253
1426273992217,4cyclictest335557-21systemd-journal23:11:572
1426273992216,4cyclictest1738682-21ntpq00:10:172
1426270992218,3cyclictest1510375-21kworker/u8:2+flush-259:020:35:161
142627799210,12cyclictest1561698-21taskset21:16:013
1426273992116,3cyclictest1619497-21apt-get22:15:132
1426273992115,4cyclictest335557-21systemd-journal20:15:002
1426273992115,4cyclictest1458100-21latency_hist19:40:002
1426270992118,2cyclictest1452535-21kworker/u8:4+events_unbound19:35:161
1426270992115,4cyclictest335557-21systemd-journal19:55:181
1426270992115,2cyclictest1707936-21kworker/u8:1+events_unbound00:25:231
1426267992118,2cyclictest1431412-21basename19:15:000
1426267992117,3cyclictest1458326-21kworker/u8:0+events_unbound19:45:230
1426267992116,3cyclictest1551944-21apt-get21:10:120
1426267992114,5cyclictest1592087-21ntpq21:45:210
1426277992015,4cyclictest1452535-21kworker/u8:4+flush-259:020:25:003
1426277992014,4cyclictest1494837-21latency_hist20:15:013
1426277992011,7cyclictest0-21swapper/319:35:003
142627799200,9cyclictest1541583-21/usr/sbin/munin21:00:203
142627799200,11cyclictest1712896-21taskset23:42:463
142627799200,11cyclictest1608746-21taskset22:02:573
142627799200,11cyclictest1525526-21taskset20:40:493
142627799200,10cyclictest1755184-21taskset00:26:193
142627799200,10cyclictest1745513-21https00:20:163
142627799200,10cyclictest1745513-21https00:20:163
142627799200,10cyclictest1462578-21/usr/sbin/munin19:40:233
142627799200,10cyclictest1457284-21chrt19:35:233
1426273992016,3cyclictest1707936-21kworker/u8:1+flush-259:000:00:492
1426273992014,4cyclictest335557-21systemd-journal22:30:002
1426273992014,4cyclictest335557-21systemd-journal00:20:012
1426273992014,4cyclictest335557-21systemd-journal00:20:002
1426273992013,5cyclictest1519755-21ntpq20:35:212
1426270992017,2cyclictest1572392-21kworker/u8:2+events_unbound00:35:221
1426270992017,2cyclictest1562082-21kworker/u8:0+flush-259:021:20:211
1426270992017,2cyclictest1520722-21kworker/u8:1+events_unbound20:54:301
1426270992017,2cyclictest1520722-21kworker/u8:1+events_unbound20:45:211
1426270992017,2cyclictest1446748-21kworker/u8:3+events_unbound20:20:201
1426270992017,2cyclictest1446748-21kworker/u8:3+events_unbound20:09:181
1426270992016,3cyclictest1707936-21kworker/u8:1+events_unbound23:40:121
1426267992017,2cyclictest0-21swapper/023:15:000
1426267992015,4cyclictest1707936-21kworker/u8:1+events_unbound00:30:060
1426267992014,4cyclictest1691629-21latency_hist23:25:020
1426267992014,4cyclictest1571461-21ntpq21:25:200
142627799191,9cyclictest1446679-21runrttasks19:27:313
1426277991914,3cyclictest1551685-21latency_hist21:10:013
1426277991912,5cyclictest1474193-21base6419:55:013
142627799191,17cyclictest507-21in:imuxsock21:29:593
142627799190,11cyclictest1582574-21taskset21:38:553
142627799190,11cyclictest1484342-21taskset20:02:523
142627799190,10cyclictest1597901-21sshd21:51:423
1426273991916,2cyclictest1603600-21latency_hist22:00:002
1426273991916,2cyclictest1603600-21latency_hist22:00:002
1426270991915,3cyclictest1686427-21kworker/u8:4+events_unbound00:08:451
1426270991915,3cyclictest1520722-21kworker/u8:1+events_unbound21:41:421
142627799181,9cyclictest1717899-21taskset23:46:153
142627799181,8cyclictest1640345-21df_inode22:35:123
142627799180,9cyclictest1526120-21/usr/sbin/munin20:45:223
142627799180,8cyclictest1655297-21runrttasks22:48:533
142627799180,10cyclictest1739453-21runrttasks00:13:143
1426273991812,4cyclictest1468484-21latency_hist19:50:002
1426270991815,2cyclictest1572392-21kworker/u8:2+events_unbound23:10:131
1426270991815,2cyclictest1520722-21kworker/u8:1+flush-259:021:15:301
1426270991814,3cyclictest1572392-21kworker/u8:2+events_unbound21:35:221
1426270991811,2cyclictest1572392-21kworker/u8:2+events_unbound23:50:201
1426267991815,2cyclictest1416221-21kworker/u8:1+flush-259:019:15:160
1426267991814,3cyclictest1572392-21kworker/u8:2+flush-259:023:55:160
1426267991814,2cyclictest1441740-21munin-run19:25:000
142627799179,6cyclictest0-21swapper/323:30:013
142627799176,9cyclictest1634264-21unixbench_multi22:25:233
142627799172,12cyclictest1755935-21cut00:30:133
1426277991713,3cyclictest335557-21systemd-journal00:19:593
1426277991710,6cyclictest61850irq/147-enp0s29f1:tx-722:09:343
142627799170,9cyclictest1723229-21taskset23:53:433
142627799170,9cyclictest1707842-21chrt23:39:213
142627799170,9cyclictest1634961-21/usr/sbin/munin22:30:233
142627799170,8cyclictest1665422-21seq22:56:273
142627799170,8cyclictest1556840-21taskset21:14:563
142627799170,8cyclictest1436443-21taskset19:18:443
1426273991713,3cyclictest1393331-21kworker/u8:2+flush-259:019:15:002
1426273991711,4cyclictest1697419-21/usr/sbin/munin23:30:142
1426270991714,2cyclictest1572392-21kworker/u8:2+events_unbound22:35:111
1426270991714,2cyclictest1393331-21kworker/u8:2+events_unbound19:20:291
1426270991711,4cyclictest1608927-21latency_hist22:05:011
1426267991713,3cyclictest1446748-21kworker/u8:3+events_unbound20:10:190
1426267991713,3cyclictest1416221-21kworker/u8:1+flush-259:020:15:230
1426267991712,3cyclictest1452479-21cron19:35:000
142627799165,9cyclictest1537676-21cut20:55:173
142627799162,10cyclictest1572633-21apt-get21:30:133
1426277991613,2cyclictest1536150-21cron20:55:003
1426277991613,2cyclictest0-21swapper/320:20:003
1426277991612,3cyclictest1697444-21apt-get23:30:123
142627799160,9cyclictest16190932sleep322:13:303
142627799160,9cyclictest1431044-21chrt19:10:463
142627799160,8cyclictest2109693-21snmpd20:29:133
1426273991613,2cyclictest500-21systemd-logind20:25:002
1426273991612,3cyclictest335557-21systemd-journal00:09:432
1426273991610,4cyclictest1755511-21latency_hist00:30:002
1426270991614,1cyclictest1572392-21kworker/u8:2+events_unbound22:45:101
1426270991613,2cyclictest1707936-21kworker/u8:1+flush-259:000:17:041
1426270991613,2cyclictest1665756-21kworker/u8:0+events_unbound23:00:231
1426270991613,2cyclictest1504711-21kworker/u8:0+events_unbound21:00:231
142626799168,6cyclictest1453129-21cp19:35:010
1426267991614,1cyclictest60350irq/132-enp0s29f1:rx-023:35:120
1426267991614,1cyclictest60350irq/132-enp0s29f1:rx-022:40:240
1426267991613,2cyclictest60350irq/132-enp0s29f1:rx-000:40:010
1426267991613,2cyclictest500-21systemd-logind22:20:000
1426267991612,3cyclictest1504711-21kworker/u8:0+events_unbound20:55:220
1426267991611,4cyclictest1458770-21irqcore19:40:160
142627799158,5cyclictest1660587-21latency_hist22:55:003
142627799152,11cyclictest1464136-21sed19:45:173
142627799151,13cyclictest1728533-21cron00:00:003
142627799151,12cyclictest1583367-21cut21:40:183
142627799151,11cyclictest1686665-21apt-get23:20:123
142627799151,11cyclictest1675202-21ntpq23:05:213
142627799151,11cyclictest1645440-21tr22:40:113
142627799150,8cyclictest1686031-21taskset23:15:453
142627799150,7cyclictest1489564-21runrttasks20:09:043
142627399159,5cyclictest1510589-21/usr/sbin/munin20:30:192
142627399159,4cyclictest1744980-21cat00:20:002
1426273991513,1cyclictest0-21swapper/223:55:002
1426273991511,3cyclictest1452535-21kworker/u8:4+flush-259:019:56:072
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-023:40:250
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-023:09:580
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-022:30:140
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-022:20:150
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-021:08:490
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:150
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-020:22:080
1426267991513,1cyclictest60350irq/132-enp0s29f1:rx-019:25:260
1426267991512,2cyclictest60350irq/132-enp0s29f1:rx-021:55:160
1426267991512,2cyclictest60350irq/132-enp0s29f1:rx-021:55:160
1426267991512,2cyclictest60350irq/132-enp0s29f1:rx-020:30:220
1426267991512,2cyclictest60350irq/132-enp0s29f1:rx-000:25:050
1426267991511,3cyclictest60350irq/132-enp0s29f1:rx-021:50:240
1426267991511,3cyclictest1593029-21kworker/u8:0+flush-259:022:05:190
1426273991410,3cyclictest1520722-21kworker/u8:1+flush-259:021:15:182
1426270991411,2cyclictest1572392-21kworker/u8:2+events_unbound22:55:181
1426270991410,3cyclictest1520722-21kworker/u8:1+events_unbound21:45:341
1426267991413,1cyclictest60350irq/132-enp0s29f1:rx-020:49:290
1426267991411,2cyclictest60350irq/132-enp0s29f1:rx-023:53:120
1426267991411,2cyclictest60350irq/132-enp0s29f1:rx-021:40:000
1426267991411,2cyclictest60350irq/132-enp0s29f1:rx-000:07:100
1426267991410,3cyclictest60350irq/132-enp0s29f1:rx-000:20:140
1426267991410,3cyclictest60350irq/132-enp0s29f1:rx-000:20:140
1426267991410,3cyclictest1452535-21kworker/u8:4+events_unbound20:00:180
142627799130,11cyclictest1588745-21sed21:45:163
142627399138,3cyclictest1708151-21/usr/sbin/munin23:40:142
142627399137,4cyclictest335557-21systemd-journal19:35:002
1426273991310,2cyclictest1637305-21kthreadcore22:30:182
1426273991310,1cyclictest0-21swapper/222:55:002
142626799139,3cyclictest1520722-21kworker/u8:1+flush-259:020:50:160
1426267991311,1cyclictest60350irq/132-enp0s29f1:rx-022:47:590
1426267991311,1cyclictest60350irq/132-enp0s29f1:rx-019:55:180
1426267991310,2cyclictest1582943-21apt-get21:40:130
142627399120,6cyclictest1572377-21munin-run21:30:002
142626799129,2cyclictest60350irq/132-enp0s29f1:rx-023:00:130
1426267991210,1cyclictest60350irq/132-enp0s29f1:rx-021:20:170
142627399118,2cyclictest1593668-21irqcore21:50:172
142627399118,2cyclictest1431743-21cpuspeed_turbos19:15:132
142627399116,3cyclictest1592929-21sshd21:49:332
142627399115,4cyclictest335557-21systemd-journal00:00:002
142627099118,2cyclictest1593029-21kworker/u8:0+events_unbound22:10:021
142627399106,3cyclictest1527251-21runrttasks20:45:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional