You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 17:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Thu Jun 18, 2026 12:43:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1794509995546,5cyclictest1914152-21ssh11:25:012
1794509995545,6cyclictest1948721-21sshd12:20:162
1794507995426,17cyclictest151ktimers/008:00:300
1794509994941,5cyclictest1826002-21systemd-run08:55:022
1794509994634,8cyclictest420-21avahi-daemon12:31:052
1794509994537,4cyclictest1003-21mta-sts-daemon11:30:312
1794509994536,5cyclictest1797533-21systemd-run07:20:012
1794507994528,12cyclictest151ktimers/009:05:270
1794509994433,7cyclictest993117-21cups-browsed11:48:102
1794509994433,7cyclictest420-21avahi-daemon10:40:562
1794509994433,7cyclictest420-21avahi-daemon10:40:562
179450999443,35cyclictest1890449-21ssh10:45:282
179450999443,35cyclictest1890449-21ssh10:45:282
179450999441,9cyclictest171rcu_preempt11:40:282
1794508994436,5cyclictest1833653-21latency_hist09:15:021
179450999437,26cyclictest1930634-21ssh11:50:282
179450999433,36cyclictest1943081-21ssh12:10:302
1794509994330,10cyclictest1954499-21latency_hist12:30:022
1794508994332,7cyclictest421-21dbus-daemon08:20:011
1794509994235,4cyclictest1886409-21kworker/u8:1-xprtiod11:00:012
1794509994234,5cyclictest1794512-21systemd-run07:10:012
1794509994233,5cyclictest1948213-21idleruntime-cro12:20:012
1794509994231,7cyclictest421-21dbus-daemon09:54:062
1794508994234,5cyclictest1002-21mta-sts-daemon08:50:241
1794507994229,10cyclictest993117-21cups-browsed12:05:020
1794509994129,8cyclictest420-21avahi-daemon11:14:442
1794509994127,9cyclictest420-21avahi-daemon10:19:492
1794509994127,9cyclictest420-21avahi-daemon10:19:492
179450899413,29cyclictest1905884-21ssh11:10:311
1794507994134,5cyclictest439-21systemd-logind09:00:020
179450799412,30cyclictest1918280-21sh11:30:280
179450799411,37cyclictest0-21swapper/011:20:260
1794509994028,9cyclictest1938026-21sshd12:02:172
1794509994028,9cyclictest1838349-21unixbench_multi09:20:392
1794509994026,11cyclictest1828301-21needreboot09:00:232
1794508994032,5cyclictest1824506-21systemd-run08:50:021
179450999396,26cyclictest993117-21cups-browsed07:40:322
1794508993932,4cyclictest0-21swapper/112:40:001
1794508993932,4cyclictest0-21swapper/112:40:001
1794508993931,5cyclictest1934193-21timerwakeupswit11:55:381
1794508993931,5cyclictest1-21systemd11:35:011
179450799391,5cyclictest0-21swapper/010:25:330
179450799391,5cyclictest0-21swapper/010:25:330
1794509993829,6cyclictest1878676-21unixbench_multi10:25:412
1794509993829,6cyclictest1878676-21unixbench_multi10:25:412
179450999382,28cyclictest1939940-21ssh12:05:292
179450999382,27cyclictest993114-21cupsd09:10:262
1794509993822,12cyclictest0-21swapper/209:35:332
1794508993830,4cyclictest0-21swapper/111:45:321
1794508993829,6cyclictest1880197-21unin-run10:30:011
1794508993829,6cyclictest1880197-21unin-run10:30:011
1794508993828,4cyclictest0-21swapper/110:50:281
1794508993828,4cyclictest0-21swapper/110:50:281
1794507993830,5cyclictest1887995-21unixbench_multi10:40:480
1794507993830,5cyclictest1887995-21unixbench_multi10:40:480
1794507993827,5cyclictest0-21swapper/009:00:240
1794507993818,14cyclictest1927567-21ssh11:45:270
179450999373,27cyclictest1834687-21ssh09:15:292
1794509993730,4cyclictest1861969-21aten2.4-expect10:00:172
1794509993730,4cyclictest0-21swapper/210:35:372
1794509993730,4cyclictest0-21swapper/210:35:372
179450899373,26cyclictest1924495-21ssh11:40:291
1794508993728,6cyclictest1901846-21kworker/u8:8+xprtiod11:40:011
1794507993729,5cyclictest1870901-21kworker/u8:15+xprtiod10:20:020
1794507993729,5cyclictest1870901-21kworker/u8:15+xprtiod10:20:020
1794509993630,3cyclictest0-21swapper/209:35:012
1794509993627,5cyclictest1000-21mta-sts-daemon12:36:432
1794509993627,5cyclictest1000-21mta-sts-daemon12:36:432
1794509993624,8cyclictest420-21avahi-daemon09:43:062
179450999361,9cyclictest1921320-21ssh11:35:272
1794508993628,5cyclictest993117-21cups-browsed09:24:011
1794507993631,3cyclictest1926577-21kworker/u8:10-nfsiod12:20:020
1794507993631,3cyclictest1892539-21munin-plugin-st10:50:000
1794507993631,3cyclictest1892539-21munin-plugin-st10:50:000
1794507993629,4cyclictest1003-21mta-sts-daemon10:22:170
1794507993629,4cyclictest1003-21mta-sts-daemon10:22:170
1794507993625,8cyclictest1850080-21missed_timers09:40:230
179450999356,21cyclictest1859600-21ssh09:55:332
179450999354,25cyclictest1909066-21ssh11:15:312
1794509993524,5cyclictest0-21swapper/209:25:312
1794509993523,9cyclictest1865623-21needreboot10:05:252
1794509993522,6cyclictest1830489-21diskmemload11:25:322
1794508993527,5cyclictest567-21gdbus09:17:021
1794508993527,5cyclictest1875582-21tail10:20:391
1794508993527,5cyclictest1875582-21tail10:20:391
1794508993527,5cyclictest1830480-21cron09:10:011
1794508993526,6cyclictest265-21systemd-journal11:24:171
1794508993526,5cyclictest0-21swapper/110:30:331
1794508993526,5cyclictest0-21swapper/110:30:331
1794508993523,8cyclictest0-21swapper/111:50:181
1794507993530,2cyclictest0-21swapper/008:25:010
1794507993527,6cyclictest1855414-21munin-run09:50:020
179450799352,29cyclictest1880738-21cpuspeed10:30:170
179450799352,29cyclictest1880738-21cpuspeed10:30:170
179450999345,21cyclictest428-21mta-sts-daemon10:30:252
179450999345,21cyclictest428-21mta-sts-daemon10:30:252
1794509993426,5cyclictest1830489-21diskmemload09:10:012
1794509993426,4cyclictest0-21swapper/209:00:012
1794508993426,5cyclictest1957576-21cat12:35:031
1794508993426,5cyclictest1915403-21sendmail_mailqu11:25:351
1794508993426,5cyclictest1892693-21latency_hist10:50:021
1794508993426,5cyclictest1892693-21latency_hist10:50:021
1794508993426,5cyclictest1817001-21munin-plugin-st08:25:011
1794508993425,6cyclictest1809491-21idleruntime-cro08:00:011
1794508993411,18cyclictest421-21dbus-daemon08:30:241
1794507993427,3cyclictest0-21swapper/009:20:280
1794507993424,7cyclictest421-21dbus-daemon10:40:010
1794507993424,7cyclictest421-21dbus-daemon10:40:010
1794507993423,7cyclictest151ktimers/011:55:310
1794509993325,5cyclictest1795986-21latency_hist07:15:012
1794509993323,5cyclictest0-21swapper/211:00:262
1794509993323,5cyclictest0-21swapper/207:45:292
1794509993322,8cyclictest1818299-21timerwakeupswit08:25:382
1794509993322,8cyclictest1818299-21timerwakeupswit08:25:382
1794508993327,3cyclictest0-21swapper/107:40:011
1794508993326,4cyclictest1846086-21cron09:35:011
179450899332,23cyclictest1949360-21ssh12:20:321
179450899332,22cyclictest1872057-21sh10:15:331
179450899332,22cyclictest1872057-21sh10:15:331
179450799334,24cyclictest1847173-21ssh09:35:300
1794507993327,3cyclictest0-21swapper/012:32:220
1794507993327,3cyclictest0-21swapper/009:25:280
1794507993326,5cyclictest1826002-21systemd-run08:55:020
1794507993321,9cyclictest1893297-21tr10:50:230
1794507993321,9cyclictest1893297-21tr10:50:230
1794507993320,9cyclictest12650irq/32-eth011:05:350
1794509993224,5cyclictest1800511-21systemd-run07:30:012
1794509993224,5cyclictest1800511-21systemd-run07:30:012
1794509993224,5cyclictest0-21swapper/211:55:192
1794509993224,3cyclictest0-21swapper/207:40:012
1794509993222,7cyclictest1809474-21grep08:00:012
1794509993222,5cyclictest0-21swapper/208:05:282
1794509993214,12cyclictest1874563-21/usr/sbin/munin10:20:182
1794509993214,12cyclictest1874563-21/usr/sbin/munin10:20:182
1794508993228,2cyclictest0-21swapper/112:25:251
1794508993226,3cyclictest0-21swapper/111:05:321
1794508993225,4cyclictest0-21swapper/110:14:391
1794508993224,5cyclictest265-21systemd-journal11:05:011
1794508993224,5cyclictest1943175-21diskmemload12:10:341
1794508993221,8cyclictest1883673-21aten_r2power_fr10:35:171
1794508993221,8cyclictest1883673-21aten_r2power_fr10:35:171
1794507993227,2cyclictest0-21swapper/011:00:000
1794507993223,7cyclictest485-21in:imuxsock12:30:010
1794507993223,6cyclictest1801987-21/usr/sbin/munin07:35:010
1794509993123,4cyclictest0-21swapper/211:05:332
179450999312,22cyclictest1868820-21ssh10:10:282
179450999312,22cyclictest1853401-21ssh09:45:302
1794508993124,4cyclictest1001-21mta-sts-daemon10:40:391
1794508993124,4cyclictest1001-21mta-sts-daemon10:40:391
179450899312,22cyclictest1847078-21ssh09:35:261
1794508993117,9cyclictest0-21swapper/110:55:281
1794507993125,4cyclictest1834270-21grep09:15:210
1794507993125,3cyclictest0-21swapper/010:10:010
1794507993124,4cyclictest1800511-21systemd-run07:30:010
1794507993124,4cyclictest1800511-21systemd-run07:30:010
1794507993118,10cyclictest1942331-21kworker/u8:13-xprtiod12:20:250
1794507993117,11cyclictest1926550-21grep11:45:010
1794507993115,9cyclictest151ktimers/008:15:260
1794509993023,3cyclictest0-21swapper/210:50:292
1794509993023,3cyclictest0-21swapper/210:50:292
1794509993020,5cyclictest0-21swapper/208:35:322
179450899305,22cyclictest271ktimers/110:05:281
1794508993023,4cyclictest1840746-21ssh09:25:231
1794508993021,6cyclictest1002-21mta-sts-daemon11:15:321
1794507993025,3cyclictest0-21swapper/009:55:010
1794507993024,3cyclictest0-21swapper/009:55:180
1794507993023,5cyclictest0-21swapper/011:40:010
179450799301,10cyclictest1868781-21ntpq10:10:270
179450999299,14cyclictest421-21dbus-daemon07:30:262
1794509992919,7cyclictest1822238-21missed_timers08:40:242
179450899293,21cyclictest443-21gpm09:55:291
1794508992922,4cyclictest1003-21mta-sts-daemon09:40:271
1794508992921,6cyclictest1820724-21missed_timers08:35:251
1794508992921,5cyclictest1948204-21latency_hist12:20:011
1794508992915,9cyclictest421-21dbus-daemon07:10:371
1794507992923,4cyclictest1804863-21grep07:40:390
1794507992922,4cyclictest0-21swapper/008:35:340
1794507992921,6cyclictest1798155-21kernelversion07:20:210
1794507992921,5cyclictest1899734-21collect211:00:270
1794507992920,6cyclictest421-21dbus-daemon11:25:340
1794507992920,5cyclictest0-21swapper/012:13:130
1794507992919,7cyclictest1908269-21acpi11:15:150
1794507992917,9cyclictest0-21swapper/008:25:200
1794507992917,9cyclictest0-21swapper/008:25:200
1794509992821,3cyclictest0-21swapper/208:30:372
1794508992821,4cyclictest1858483-21cron09:55:011
1794508992821,4cyclictest1797480-21cron07:20:011
1794508992819,7cyclictest1938023-21sh12:02:171
1794508992810,9cyclictest1000-21mta-sts-daemon07:30:271
179450799284,18cyclictest1905894-21ssh11:10:320
179450799283,11cyclictest1830489-21diskmemload12:06:170
1794507992822,4cyclictest1806403-21grep07:45:380
1794507992822,3cyclictest0-21swapper/008:10:380
1794507992821,5cyclictest265-21systemd-journal09:35:020
1794507992821,4cyclictest1824506-21systemd-run08:50:020
179450999273,14cyclictest428-21mta-sts-daemon08:10:292
1794508992721,3cyclictest0-21swapper/110:00:401
1794508992721,3cyclictest0-21swapper/108:05:011
1794508992721,3cyclictest0-21swapper/107:45:011
1794508992719,5cyclictest1821765-21telnet08:40:171
1794508992717,7cyclictest1828833-21unixbench-2d09:00:361
1794508992716,7cyclictest0-21swapper/112:05:411
1794508992715,4cyclictest1002-21mta-sts-daemon09:46:431
179450799272,19cyclictest1831616-21ssh09:10:310
1794507992718,6cyclictest993117-21cups-browsed10:02:110
1794507992710,14cyclictest567-21gdbus12:36:350
1794507992710,14cyclictest567-21gdbus12:36:350
1794509992618,5cyclictest1823525-21fschecks_time08:45:202
1794508992621,2cyclictest0-21swapper/109:00:011
1794508992619,4cyclictest1817927-21ntp_offset08:25:291
1794508992619,4cyclictest1817927-21ntp_offset08:25:291
1794507992620,3cyclictest1807994-21kworker/u8:2+xprtiod07:55:010
179450799261,9cyclictest1930831-21ps11:50:360
1794509992516,6cyclictest1815517-21systemd-run08:20:012
1794509992516,6cyclictest1811008-21systemd-run08:05:012
1794509992516,6cyclictest0-21swapper/207:20:202
1794508992518,4cyclictest1799815-21needreboot07:25:261
1794508992518,4cyclictest1799815-21needreboot07:25:261
1794508992517,4cyclictest0-21swapper/107:50:261
1794507992515,7cyclictest12650irq/32-eth008:00:010
1794508992419,3cyclictest0-21swapper/107:45:181
1794508992417,5cyclictest1812493-21idleruntime-cro08:10:011
1794508992417,5cyclictest0-21swapper/107:20:381
1794508992414,6cyclictest0-21swapper/108:10:251
179450799246,12cyclictest151ktimers/007:10:240
179450799242,16cyclictest1802848-21ntpq07:35:270
1794507992417,4cyclictest1822872-21unixbench_multi08:40:380
1794509992317,3cyclictest0-21swapper/208:20:162
1794509992316,3cyclictest0-21swapper/207:50:392
1794507992318,3cyclictest151ktimers/008:05:310
1794507992318,2cyclictest0-21swapper/007:20:010
1794507992317,4cyclictest1819698-21awk08:30:360
1794508992216,3cyclictest0-21swapper/107:10:011
179451099212,5cyclictest0-21swapper/310:10:263
179451099181,8cyclictest0-21swapper/307:30:273
179451099181,6cyclictest0-21swapper/310:20:333
179451099181,6cyclictest0-21swapper/310:20:333
179451099172,8cyclictest0-21swapper/312:10:283
179451099172,7cyclictest0-21swapper/311:35:313
179451099172,6cyclictest0-21swapper/312:15:313
179451099171,7cyclictest0-21swapper/311:30:283
179451099162,6cyclictest0-21swapper/311:45:293
179451099162,6cyclictest0-21swapper/309:15:263
179451099162,4cyclictest0-21swapper/308:25:253
179451099162,4cyclictest0-21swapper/308:25:253
1794507991611,2cyclictest0-21swapper/007:10:010
179451099152,6cyclictest0-21swapper/310:25:293
179451099152,6cyclictest0-21swapper/310:25:293
179451099152,5cyclictest0-21swapper/307:15:253
179451099151,7cyclictest0-21swapper/311:20:263
179451099151,7cyclictest0-21swapper/310:55:303
179451099151,6cyclictest0-21swapper/308:05:303
179451099151,6cyclictest0-21swapper/307:50:283
179451099142,6cyclictest0-21swapper/310:00:223
179451099142,6cyclictest0-21swapper/307:25:313
179451099142,6cyclictest0-21swapper/307:25:313
179451099142,5cyclictest0-21swapper/308:20:313
179451099141,7cyclictest0-21swapper/312:30:203
179451099141,6cyclictest0-21swapper/311:05:323
179451099141,6cyclictest0-21swapper/309:35:243
179451099141,6cyclictest0-21swapper/309:00:323
179451099141,6cyclictest0-21swapper/307:40:313
179451099141,6cyclictest0-21swapper/307:35:333
179451099133,6cyclictest0-21swapper/312:05:353
179451099132,7cyclictest0-21swapper/308:45:293
179451099132,6cyclictest0-21swapper/312:25:393
179451099132,6cyclictest0-21swapper/311:55:253
179451099132,6cyclictest0-21swapper/309:20:283
179451099132,5cyclictest0-21swapper/312:00:353
179451099132,5cyclictest0-21swapper/308:10:293
179451099131,7cyclictest0-21swapper/309:10:293
179451099131,6cyclictest0-21swapper/310:50:283
179451099131,6cyclictest0-21swapper/310:50:283
179451099131,5cyclictest0-21swapper/308:35:303
179451099123,5cyclictest0-21swapper/309:55:393
179451099123,4cyclictest0-21swapper/311:40:293
179451099122,6cyclictest0-21swapper/311:50:263
179451099122,6cyclictest0-21swapper/311:25:343
179451099122,6cyclictest0-21swapper/310:40:473
179451099122,6cyclictest0-21swapper/310:40:473
179451099122,6cyclictest0-21swapper/310:05:213
179451099122,6cyclictest0-21swapper/309:10:013
179451099122,5cyclictest0-21swapper/309:40:263
179451099122,5cyclictest0-21swapper/307:50:013
179451099122,4cyclictest0-21swapper/310:15:163
179451099122,4cyclictest0-21swapper/310:15:163
179451099121,6cyclictest0-21swapper/311:15:273
179451099121,6cyclictest0-21swapper/311:10:393
179451099121,6cyclictest0-21swapper/311:00:263
179451099121,6cyclictest0-21swapper/310:35:173
179451099121,6cyclictest0-21swapper/310:35:173
179451099121,6cyclictest0-21swapper/310:30:333
179451099121,6cyclictest0-21swapper/310:30:333
179451099121,6cyclictest0-21swapper/309:30:213
179451099112,5cyclictest0-21swapper/309:00:013
179451099112,5cyclictest0-21swapper/307:20:253
179451099111,6cyclictest0-21swapper/312:35:163
179451099111,6cyclictest0-21swapper/312:35:163
179451099111,6cyclictest0-21swapper/309:50:323
179451099111,5cyclictest0-21swapper/310:45:183
179451099111,5cyclictest0-21swapper/310:45:183
179451099104,4cyclictest0-21swapper/308:45:023
179451099102,5cyclictest0-21swapper/309:25:163
179451099102,5cyclictest0-21swapper/308:15:173
179451099101,6cyclictest0-21swapper/312:20:203
179451099101,6cyclictest0-21swapper/309:45:193
179451099101,6cyclictest0-21swapper/308:00:013
179451099101,5cyclictest0-21swapper/308:55:023
179451099101,5cyclictest0-21swapper/308:00:173
17945109993,4cyclictest0-21swapper/307:10:253
17945109992,5cyclictest0-21swapper/308:30:193
17945109991,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional