You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-13 - 09:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 13, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1519923998581,3cyclictest1691116-21kworker/u8:0+flush-259:022:45:022
1519923994542,2cyclictest1815169-21kworker/u8:2+flush-259:023:55:212
1519926994442,1cyclictest1737262-21fwupd22:40:013
1519926994335,5cyclictest1753090-21latency_hist22:55:003
1519921994340,2cyclictest1618395-21kworker/u8:1+flush-259:020:45:211
1519916994339,2cyclictest1618395-21kworker/u8:1+events_unbound21:05:190
1519921994239,2cyclictest1815169-21kworker/u8:2+events_unbound23:55:151
1519921994239,2cyclictest1476895-21kworker/u8:1+flush-259:019:20:181
1519923994132,2cyclictest1550993-21kworker/u8:0+flush-259:019:40:202
1519926994033,4cyclictest1613404-21cp20:40:013
1519923994037,2cyclictest1841367-21apt-get00:20:012
1519923994036,3cyclictest1618395-21kworker/u8:1+flush-259:020:41:552
1519923994031,2cyclictest1691116-21kworker/u8:0+events_unbound22:00:132
1519921994037,2cyclictest1592539-21kworker/u8:0+flush-259:020:55:001
1519923993936,2cyclictest1541118-21kworker/u8:1+flush-259:019:35:012
1519921993936,2cyclictest1541118-21kworker/u8:1+flush-259:020:05:211
1519921993935,3cyclictest1550993-21kworker/u8:0+events_unbound19:55:231
1519926993832,4cyclictest1721794-21latency_hist22:25:003
1519923993834,3cyclictest1665352-21kworker/u8:3+flush-259:022:35:202
1519921993835,2cyclictest1541118-21kworker/u8:1+events_unbound20:00:241
1519921993831,5cyclictest1592518-21latency_hist20:20:011
1519923993734,2cyclictest1857507-21kworker/u8:0+events_unbound00:35:222
1519923993731,4cyclictest1623922-21latency_hist20:50:012
1519916993733,3cyclictest1550993-21kworker/u8:0+flush-259:019:40:000
1519923993633,2cyclictest1659980-21kworker/u8:2+flush-259:021:55:182
1519921993633,2cyclictest1815169-21kworker/u8:2+flush-259:000:20:161
1519921993633,2cyclictest1789740-21kworker/u8:0+flush-259:023:35:231
1519921993633,2cyclictest1629313-21kworker/u8:2+flush-259:021:10:211
1519921993632,3cyclictest1758479-21kworker/u8:1+events_unbound23:05:201
1519916993632,3cyclictest1665352-21kworker/u8:3+events_unbound22:10:210
1519923993532,2cyclictest1618395-21kworker/u8:1+flush-259:021:25:212
1519921993532,2cyclictest1665352-21kworker/u8:3+events_unbound22:20:141
1519921993532,2cyclictest1618395-21kworker/u8:1+events_unbound21:30:221
1519921993532,2cyclictest1592539-21kworker/u8:0+events_unbound20:30:241
1519921993532,2cyclictest1556426-21kworker/u8:2+flush-259:020:10:201
1519923993431,2cyclictest1836911-21kworker/u8:3+flush-259:000:35:002
1519923993430,2cyclictest1841367-21apt-get00:20:022
1519923993427,3cyclictest1665352-21kworker/u8:3+events_unbound23:20:152
1519921993431,2cyclictest1789740-21kworker/u8:0+events_unbound23:50:231
1519921993427,3cyclictest1665352-21kworker/u8:3+events_unbound23:20:191
1519916993430,3cyclictest1476895-21kworker/u8:1+flush-259:019:10:240
1519926993328,3cyclictest1841395-21gpgv00:20:003
1519923993328,4cyclictest1722031-21/usr/sbin/munin22:25:142
1519921993330,2cyclictest1789740-21kworker/u8:0+flush-259:000:10:221
1519921993330,2cyclictest1504572-21kworker/u8:2+flush-259:019:30:201
1519921993329,3cyclictest1659980-21kworker/u8:2+flush-259:021:50:211
1519916993329,3cyclictest1592539-21kworker/u8:0+flush-259:020:25:210
1519916993327,4cyclictest252-21systemd-journal00:14:200
1519916993327,4cyclictest1535281-21latency_hist19:25:010
1519926993228,2cyclictest1815169-21kworker/u8:2+events_unbound00:20:203
1519926993226,4cyclictest1773783-21apt-get23:15:013
1519926993226,4cyclictest1582167-21latency_hist20:10:013
1519923993229,2cyclictest1711488-21kworker/u8:2+flush-259:022:15:152
1519923993228,3cyclictest1476895-21kworker/u8:1+events_unbound19:20:122
1519921993229,2cyclictest1592539-21kworker/u8:0+events_unbound20:25:231
1519921993228,3cyclictest1618395-21kworker/u8:1+flush-259:021:20:251
1519916993227,4cyclictest252-21systemd-journal20:25:000
1519923993128,2cyclictest1556426-21kworker/u8:2+events_unbound20:15:192
1519921993128,2cyclictest1758479-21kworker/u8:1+flush-259:023:30:211
1519921993128,2cyclictest1649566-21kworker/u8:0+events_unbound21:25:141
1519921993127,3cyclictest1659980-21kworker/u8:2+events_unbound21:55:201
1519921993127,3cyclictest1629313-21kworker/u8:2+events_unbound20:55:241
1519916993125,4cyclictest1665360-21/usr/sbin/munin21:30:240
1519916993125,4cyclictest1613225-21latency_hist20:40:010
1519923993027,2cyclictest1592539-21kworker/u8:0+flush-259:020:36:562
1519923993026,3cyclictest1691116-21kworker/u8:0+events_unbound22:40:032
1519923993026,3cyclictest1556426-21kworker/u8:2+events_unbound20:25:142
1519923993026,3cyclictest1541118-21kworker/u8:1+flush-259:020:00:162
1519921993027,2cyclictest1815169-21kworker/u8:2+events_unbound00:00:141
1519921993027,2cyclictest1665352-21kworker/u8:3+flush-259:022:00:221
1519921993027,2cyclictest1665352-21kworker/u8:3+events_unbound22:55:211
1519921993027,2cyclictest1665352-21kworker/u8:3+events_unbound22:55:211
1519921993026,3cyclictest1659980-21kworker/u8:2+events_unbound21:45:221
1519916993027,2cyclictest1815169-21kworker/u8:2+flush-259:023:55:190
1519926992923,4cyclictest1773784-21latency_hist23:15:013
1519923992926,2cyclictest1836911-21kworker/u8:3+flush-259:000:25:202
1519923992926,2cyclictest1550993-21kworker/u8:0+events_unbound19:55:172
1519923992926,2cyclictest1541118-21kworker/u8:1+flush-259:019:50:162
1519923992923,4cyclictest1793984-21ntpq23:30:212
1519921992926,2cyclictest1758479-21kworker/u8:1+events_unbound23:10:241
1519921992925,3cyclictest1691116-21kworker/u8:0+events_unbound22:50:141
1519916992920,8cyclictest1618395-21kworker/u8:1+flush-259:020:50:000
1519923992825,2cyclictest1618395-21kworker/u8:1+events_unbound21:15:152
1519921992825,2cyclictest1820727-21kworker/u8:3+events_unbound00:05:221
1519921992825,2cyclictest1665352-21kworker/u8:3+events_unbound23:25:231
1519921992825,2cyclictest1613905-21apt-get20:40:111
1519921992824,3cyclictest1665352-21kworker/u8:3+events_unbound22:45:141
1519916992825,2cyclictest1556426-21kworker/u8:2+events_unbound20:10:140
1519916992824,3cyclictest1815169-21kworker/u8:2+events_unbound00:30:010
1519926992719,5cyclictest1649694-21latency_hist21:15:003
1519923992724,2cyclictest1758479-21kworker/u8:1+events_unbound23:10:222
1519923992724,2cyclictest1665352-21kworker/u8:3+flush-259:022:20:152
1519923992724,2cyclictest1618395-21kworker/u8:1+flush-259:021:05:202
1519921992724,2cyclictest1857507-21kworker/u8:0+flush-259:000:35:151
1519921992724,2cyclictest1691116-21kworker/u8:0+events_unbound22:25:181
1519921992724,2cyclictest1665352-21kworker/u8:3+flush-259:021:40:191
1519921992724,2cyclictest1623960-21kworker/u8:3+flush-259:021:00:241
1519921992724,2cyclictest1623960-21kworker/u8:3+events_unbound21:15:231
1519921992724,2cyclictest1541118-21kworker/u8:1+events_unbound19:35:141
1519921992724,2cyclictest1476895-21kworker/u8:1+flush-259:019:10:151
1519921992723,3cyclictest1691116-21kworker/u8:0+events_unbound22:05:211
1519916992722,4cyclictest1541118-21kworker/u8:1+events_unbound19:45:290
1519916992721,4cyclictest1649954-21apt-get21:15:130
1519926992620,4cyclictest252-21systemd-journal22:28:203
1519923992622,3cyclictest1618395-21kworker/u8:1+flush-259:021:30:162
1519923992622,3cyclictest1541118-21kworker/u8:1+events_unbound19:35:222
1519923992622,2cyclictest1592539-21kworker/u8:0+events_unbound20:50:232
1519921992623,2cyclictest1665352-21kworker/u8:3+flush-259:023:15:261
1519916992623,2cyclictest1665352-21kworker/u8:3+events_unbound22:35:230
1519916992622,3cyclictest1836911-21kworker/u8:3+flush-259:000:30:210
1519916992622,3cyclictest1659980-21kworker/u8:2+flush-259:021:45:210
1519916992622,3cyclictest1659980-21kworker/u8:2+flush-259:021:40:240
1519916992621,4cyclictest1820727-21kworker/u8:3+flush-259:000:05:150
151992699258,4cyclictest1762520-21ntpq23:00:213
1519923992521,3cyclictest1758479-21kworker/u8:1+events_unbound23:28:202
1519923992520,3cyclictest1675660-21/usr/sbin/munin21:40:142
1519921992522,2cyclictest1550993-21kworker/u8:0+flush-259:019:40:221
1519921992522,2cyclictest1530183-21kworker/u8:0+flush-259:019:25:241
1519921992522,2cyclictest1487015-21kworker/u8:3+events_unbound19:15:251
1519926992417,5cyclictest252-21systemd-journal23:34:203
1519923992421,2cyclictest1629313-21kworker/u8:2+flush-259:020:55:252
1519923992420,3cyclictest1789740-21kworker/u8:0+events_unbound23:51:222
1519923992420,3cyclictest1665352-21kworker/u8:3+flush-259:023:40:222
1519923992420,3cyclictest1665352-21kworker/u8:3+events_unbound22:10:112
1519921992421,2cyclictest1836911-21kworker/u8:3+flush-259:000:30:241
1519921992421,2cyclictest1789740-21kworker/u8:0+events_unbound00:15:161
1519916992420,3cyclictest1487015-21kworker/u8:3+events_unbound19:15:230
1519923992320,2cyclictest1691116-21kworker/u8:0+flush-259:022:55:252
1519923992320,2cyclictest1691116-21kworker/u8:0+flush-259:022:55:242
1519923992320,2cyclictest1556426-21kworker/u8:2+flush-259:020:20:262
1519923992320,2cyclictest1476895-21kworker/u8:1+events_unbound19:10:282
1519923992319,3cyclictest1789740-21kworker/u8:0+events_unbound23:38:222
1519923992319,3cyclictest1758479-21kworker/u8:1+events_unbound23:01:222
1519921992320,2cyclictest1691116-21kworker/u8:0+events_unbound22:33:201
1519921992320,2cyclictest1665352-21kworker/u8:3+events_unbound22:15:231
1519921992320,2cyclictest1556426-21kworker/u8:2+flush-259:020:35:161
1519921992319,3cyclictest1556426-21kworker/u8:2+flush-259:020:20:211
1519916992320,2cyclictest1504572-21kworker/u8:2+flush-259:019:30:230
1519916992319,3cyclictest1691116-21kworker/u8:0+events_unbound22:30:230
1519916992319,3cyclictest1670520-21kworker/u8:0+flush-259:021:35:260
1519916992319,3cyclictest1550993-21kworker/u8:0+events_unbound19:40:170
1519916992319,2cyclictest1-21systemd19:51:200
1519923992219,3cyclictest1618395-21kworker/u8:1+events_unbound21:21:222
1519923992219,2cyclictest1691116-21kworker/u8:0+events_unbound22:30:212
1519923992219,2cyclictest1659980-21kworker/u8:2+events_unbound21:45:262
1519923992219,2cyclictest1541118-21kworker/u8:1+flush-259:019:45:252
1519923992215,2cyclictest1504572-21kworker/u8:2+events_unbound19:28:192
1519916992218,3cyclictest1758479-21kworker/u8:1+flush-259:023:23:250
1519916992218,3cyclictest1541118-21kworker/u8:1+events_unbound20:00:140
1519926992116,3cyclictest1826119-21apt-get00:05:123
1519926992116,3cyclictest1670520-21kworker/u8:0+flush-259:021:35:263
1519921992116,4cyclictest1639624-21/usr/sbin/munin21:05:151
1519916992118,2cyclictest1789740-21kworker/u8:0+flush-259:023:50:260
1519916992118,2cyclictest1623960-21kworker/u8:3+flush-259:020:59:510
1519916992117,3cyclictest1789740-21kworker/u8:0+events_unbound23:45:190
1519916992117,3cyclictest1665352-21kworker/u8:3+flush-259:022:25:240
1519916992116,4cyclictest1556426-21kworker/u8:2+flush-259:020:44:510
1519926992014,4cyclictest1732379-21apt-get22:35:113
1519926992013,4cyclictest1654849-21latency_hist21:20:013
1519923992017,2cyclictest1691116-21kworker/u8:0+events_unbound22:50:242
1519923992017,2cyclictest1691116-21kworker/u8:0+events_unbound22:05:152
1519923992017,2cyclictest1623960-21kworker/u8:3+events_unbound21:14:212
1519921992017,2cyclictest1665352-21kworker/u8:3+flush-259:023:00:151
1519916992017,2cyclictest1789740-21kworker/u8:0+events_unbound00:15:130
1519916992016,3cyclictest1665352-21kworker/u8:3+flush-259:022:15:200
1519916992016,3cyclictest1592539-21kworker/u8:0+events_unbound20:46:580
1519916992016,3cyclictest1530183-21kworker/u8:0+events_unbound19:25:230
1519916992014,4cyclictest1862491-21latency_hist00:40:000
151992699193,4cyclictest1705511-21ld22:05:223
1519926991911,5cyclictest1836185-21latency_hist00:15:013
1519923991915,3cyclictest1556426-21kworker/u8:2+events_unbound20:35:002
1519923991914,3cyclictest252-21systemd-journal21:52:062
1519923991912,2cyclictest1820727-21kworker/u8:3+events_unbound00:05:182
1519921991916,2cyclictest1665352-21kworker/u8:3+events_unbound22:35:111
1519921991915,3cyclictest1706564-21/usr/sbin/munin22:10:141
1519916991916,2cyclictest1815169-21kworker/u8:2+flush-259:000:20:210
1519916991916,2cyclictest1556426-21kworker/u8:2+events_unbound20:15:150
1519916991915,3cyclictest1665352-21kworker/u8:3+flush-259:023:19:560
1519916991915,3cyclictest1665352-21kworker/u8:3+events_unbound22:00:170
1519916991915,3cyclictest1623960-21kworker/u8:3+flush-259:021:00:180
1519916991915,3cyclictest1577072-21kworker/u8:3+events_unbound20:10:000
151992699183,4cyclictest1659103-21ntpq21:20:223
1519926991815,2cyclictest1732130-21idleruntime-cro22:35:003
1519926991812,4cyclictest509-21rs:main3
1519926991812,4cyclictest509-21rs:main3
1519923991815,2cyclictest1830992-21kworker/u8:1+flush-259:000:10:582
1519923991815,2cyclictest1665352-21kworker/u8:3+flush-259:023:15:012
1519923991814,3cyclictest1665352-21kworker/u8:3+events_unbound23:46:432
1519921991815,2cyclictest1836911-21kworker/u8:3+events_unbound00:29:221
1519921991815,2cyclictest1665352-21kworker/u8:3+flush-259:022:40:201
1519916991814,3cyclictest1691116-21kworker/u8:0+flush-259:022:55:000
1519916991814,3cyclictest1655081-21/usr/sbin/munin21:20:150
1519916991813,4cyclictest252-21systemd-journal23:00:010
1519916991813,4cyclictest252-21systemd-journal23:00:000
1519916991813,4cyclictest1618395-21kworker/u8:1+events_unbound21:25:240
151992699173,5cyclictest1669446-21ntpq21:30:223
1519926991712,4cyclictest1789740-21kworker/u8:0+flush-259:023:45:163
1519923991714,2cyclictest1556426-21kworker/u8:2+events_unbound20:11:232
1519923991714,2cyclictest1550993-21kworker/u8:0+flush-259:020:05:152
1519916991715,1cyclictest1758479-21kworker/u8:1+flush-259:023:30:000
1519916991714,2cyclictest1659980-21kworker/u8:2+flush-259:021:55:190
1519916991713,3cyclictest1815169-21kworker/u8:2+events_unbound00:00:290
1519916991713,3cyclictest1789740-21kworker/u8:0+events_unbound23:39:220
151992699168,5cyclictest252-21systemd-journal00:35:003
151992699163,4cyclictest1780013-21cat23:20:163
1519926991612,2cyclictest1712140-21irqcore22:15:153
1519926991610,5cyclictest1659980-21kworker/u8:2+flush-259:022:00:013
1519923991612,3cyclictest1820727-21kworker/u8:3+events_unbound00:01:242
1519923991612,3cyclictest1623960-21kworker/u8:3+flush-259:021:00:172
1519921991613,2cyclictest1665352-21kworker/u8:3+flush-259:023:45:101
1519916991614,1cyclictest60350irq/132-enp0s29f1:rx-023:31:230
1519916991613,2cyclictest60350irq/132-enp0s29f1:rx-021:10:240
1519916991613,2cyclictest1758479-21kworker/u8:1+events_unbound23:05:210
1519916991613,2cyclictest1659980-21kworker/u8:2+events_unbound21:50:280
1519916991612,3cyclictest1665352-21kworker/u8:3+flush-259:022:06:250
1519916991612,3cyclictest1665352-21kworker/u8:3+events_unbound23:40:180
1519916991612,3cyclictest1592539-21kworker/u8:0+events_unbound20:32:210
1519916991610,4cyclictest1773966-21cp23:15:000
151992699159,4cyclictest252-21systemd-journal21:06:213
151992699159,4cyclictest252-21systemd-journal19:39:183
151992699152,10cyclictest1530307-21cat19:20:013
1519926991510,3cyclictest1675860-21fschecks_count21:40:143
1519926991510,3cyclictest1629313-21kworker/u8:2+flush-259:020:56:253
1519921991512,2cyclictest1541118-21kworker/u8:1+flush-259:019:45:141
1519921991511,3cyclictest1789740-21kworker/u8:0+events_unbound23:44:001
1519921991511,3cyclictest1550993-21kworker/u8:0+events_unbound19:50:051
1519921991510,3cyclictest1670522-21/usr/sbin/munin21:35:151
1519916991512,2cyclictest60350irq/132-enp0s29f1:rx-019:57:100
1519916991512,2cyclictest1742000-21unixbench_singl22:40:270
1519916991510,4cyclictest1691116-21kworker/u8:0+flush-259:022:23:250
151992699149,4cyclictest1556426-21kworker/u8:2+flush-259:020:20:223
151992699148,4cyclictest1800297-21apt-get23:40:123
151992699147,5cyclictest1820689-21ls00:00:003
151992699147,5cyclictest1710677-21/usr/sbin/munin22:10:223
1519926991412,1cyclictest0-21swapper/320:00:003
151992699141,11cyclictest509-21rs:main3
151992699141,11cyclictest252-21systemd-journal23:36:203
1519926991411,1cyclictest0-21swapper/320:40:163
1519926991410,2cyclictest1821388-21irqcore00:00:173
1519926991410,2cyclictest1629072-21idleruntime-cro20:55:003
1519923991412,1cyclictest1758479-21kworker/u8:1+events_unbound23:05:252
1519923991411,2cyclictest1670520-21kworker/u8:0+flush-259:021:39:302
1519916991412,1cyclictest60350irq/132-enp0s29f1:rx-022:49:120
1519916991411,1cyclictest0-21swapper/019:10:010
151992699139,2cyclictest0-21swapper/321:45:253
151992699137,4cyclictest1638500-21ntpq21:00:213
151992699137,4cyclictest1608055-21dump-pmu-power20:34:593
151992699137,4cyclictest1602848-21cron20:30:003
151992699135,6cyclictest252-21systemd-journal19:55:003
151992699133,2cyclictest1697314-21irqstats22:00:173
151992699132,2cyclictest1524623-21users19:10:263
1519926991311,1cyclictest1519908-21cyclictest21:55:013
1519926991310,2cyclictest1619150-21cpuspeed_turbos20:45:133
1519923991310,2cyclictest1487015-21kworker/u8:3+events_unbound19:15:572
151991699139,3cyclictest1758487-21/usr/sbin/munin23:00:140
151992699127,3cyclictest1815512-21awk23:55:013
151992699126,4cyclictest1753452-21grep22:55:123
151992699126,4cyclictest1753452-21grep22:55:123
151992699126,4cyclictest1551558-21tr19:40:123
151992699125,5cyclictest1661712-21grep21:25:173
151992699124,6cyclictest1572321-21cat20:00:133
151992699124,6cyclictest1557421-21sed19:45:183
151992699123,2cyclictest1541297-21df19:30:133
151992699122,2cyclictest1847518-21hddtemp_smartct00:25:163
151992699121,2cyclictest1583413-21irqstats20:10:173
151992699116,3cyclictest1857654-21grep00:35:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional