You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 05:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Fri May 01, 2026 00:43:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1433848996134,22cyclictest1542236-21latency_hist22:40:021
1433848995932,23cyclictest420-21avahi-daemon22:00:021
1433848995932,23cyclictest420-21avahi-daemon22:00:021
1433848995448,3cyclictest0-21swapper/122:45:011
1433848995448,3cyclictest0-21swapper/122:45:011
1433848995430,21cyclictest1498053-21ssh21:45:021
1433849995243,6cyclictest1594333-21cron23:45:002
1433848995133,14cyclictest0-21swapper/100:21:071
1433848995125,22cyclictest0-21swapper/121:55:011
1433848995123,25cyclictest1625746-21aten_r2power_po00:25:391
143384899496,6cyclictest1551394-21ssh22:50:441
1433848994940,6cyclictest1558264-21systemd-run23:00:011
1433848994939,7cyclictest538-21wpa_supplicant22:25:501
1433848994928,18cyclictest1587451-21needreboot23:35:421
1433848994928,18cyclictest1587451-21needreboot23:35:421
1433848994918,7cyclictest0-21swapper/123:15:571
1433847994941,5cyclictest1546144-21idleruntime-cro22:45:010
1433847994941,5cyclictest1546144-21idleruntime-cro22:45:010
1433847994928,12cyclictest12350irq/32-eth023:40:460
143384999484,37cyclictest1551440-21ssh22:50:452
1433848994838,7cyclictest3838849-21cups-browsed20:00:501
1433848994822,3cyclictest0-21swapper/121:30:461
1433848994815,8cyclictest1479257-21sh21:20:441
1433848994815,8cyclictest1479257-21sh21:20:441
1433848994737,6cyclictest1633165-21latency_hist00:35:031
1433848994723,3cyclictest0-21swapper/100:20:011
1433848994715,7cyclictest0-21swapper/120:10:551
143384799473,35cyclictest1515422-21ssh22:05:500
1433848994623,3cyclictest0-21swapper/122:45:571
1433848994623,3cyclictest0-21swapper/122:45:571
1433848994620,5cyclictest1562264-21grep23:05:011
1433849994535,4cyclictest0-21swapper/223:25:452
1433848994525,3cyclictest0-21swapper/121:16:221
1433848994525,3cyclictest0-21swapper/121:16:221
1433848994520,5cyclictest1608285-21ssh00:01:011
1433849994436,5cyclictest1482105-21systemd-run21:25:012
1433849994436,5cyclictest1482105-21systemd-run21:25:012
143384899442,20cyclictest1523360-21awk22:15:481
1433847994415,21cyclictest1563649-21ssh23:05:520
1433847994413,26cyclictest1599645-21ssh23:50:470
1433848994335,6cyclictest0-21swapper/121:40:011
1433848994333,6cyclictest1442921-21systemd-run19:40:011
1433848994319,4cyclictest1579110-21fschecks_count23:25:371
1433847994335,5cyclictest1613418-21latency_hist00:10:020
143384999424,35cyclictest3838849-21cups-browsed21:45:432
143384899426,13cyclictest1634212-21ssh00:35:441
143384899425,16cyclictest428-21mta-sts-daemon19:55:441
1433847994234,5cyclictest1478010-21ls21:20:010
1433847994234,5cyclictest1478010-21ls21:20:010
1433847994230,9cyclictest1606418-21munin-plugin-st00:00:010
1433847994230,8cyclictest1634148-21needreboot00:35:420
1433849994134,3cyclictest0-21swapper/223:15:522
1433849994133,5cyclictest1538064-21cron22:35:012
1433849994133,5cyclictest1478016-21cron21:20:012
1433849994133,5cyclictest1478016-21cron21:20:012
1433849994133,4cyclictest0-21swapper/221:55:452
1433849994133,4cyclictest0-21swapper/221:55:452
1433849994033,3cyclictest0-21swapper/221:30:452
1433849994032,5cyclictest1626926-21unixbench_multi00:26:012
1433849994030,6cyclictest420-21avahi-daemon23:06:402
1433849994030,5cyclictest0-21swapper/223:00:482
1433848994027,9cyclictest1436838-21idleruntime-cro19:20:001
1433848994027,9cyclictest1436838-21idleruntime-cro19:20:001
143384799408,15cyclictest1055-21mta-sts-daemon22:10:490
1433847994031,6cyclictest3838849-21cups-browsed22:45:340
1433847994031,6cyclictest3838849-21cups-browsed22:45:340
1433847994030,7cyclictest0-21swapper/023:15:000
1433849993932,4cyclictest1514027-21munin-plugin-st22:05:002
1433849993931,5cyclictest3838849-21cups-browsed19:30:452
1433849993931,3cyclictest0-21swapper/200:40:012
1433848993930,6cyclictest1459403-21systemd-run20:35:011
1433847993917,5cyclictest0-21swapper/023:15:510
143384999382,26cyclictest1531360-21ssh22:25:462
1433848993824,9cyclictest1515680-21switchtime22:05:551
1433847993830,5cyclictest1510073-21systemd-run22:00:020
1433847993830,5cyclictest1510073-21systemd-run22:00:020
1433847993825,11cyclictest1445634-21timerandwakeup19:45:550
1433847993825,10cyclictest1626577-21processes00:25:560
1433849993731,3cyclictest0-21swapper/200:30:492
1433849993730,3cyclictest0-21swapper/221:25:542
1433849993727,7cyclictest439-21systemd-logind22:20:012
1433849993726,8cyclictest1607551-21missed_timers00:00:442
1433849993725,9cyclictest1527151-21missed_timers22:20:412
1433848993730,3cyclictest0-21swapper/121:45:431
1433848993729,4cyclictest0-21swapper/120:20:011
1433848993728,6cyclictest1-21systemd23:35:021
1433848993728,5cyclictest0-21swapper/123:25:011
143384799372,28cyclictest1622669-21modprobe00:21:090
143384799372,25cyclictest1559509-21ssh23:00:460
1433847993716,17cyclictest1523357-21diskmemload22:15:480
1433849993630,3cyclictest0-21swapper/221:05:012
1433849993626,7cyclictest1590318-21munin-run23:40:002
1433849993626,7cyclictest1590318-21munin-run23:40:002
1433849993625,8cyclictest1618995-21timerwakeupswit00:15:592
1433848993627,6cyclictest1511494-21sendmail_mailst22:00:531
1433847993630,3cyclictest0-21swapper/021:30:350
1433847993624,8cyclictest1595696-21sh23:45:490
1433847993623,9cyclictest421-21dbus-daemon21:53:140
1433849993529,3cyclictest0-21swapper/200:00:012
1433849993528,3cyclictest0-21swapper/223:45:452
1433849993527,5cyclictest1449409-21fschecks_count20:00:382
1433847993527,5cyclictest1471522-21switchtime21:10:540
1433847993526,7cyclictest1454919-21systemd-run20:20:010
1433847993523,9cyclictest1608376-21head00:01:010
143384999348,19cyclictest1495368-21ssh21:40:492
143384999343,25cyclictest1555406-21ssh22:55:442
1433849993427,4cyclictest0-21swapper/200:10:522
1433849993426,5cyclictest1493999-21sendmail21:40:012
1433849993426,5cyclictest1-21systemd23:25:012
1433849993425,5cyclictest1538653-21head22:35:352
1433849993424,8cyclictest1448184-21needreboot19:55:422
143384899346,20cyclictest1527334-21ssh22:20:461
1433848993426,5cyclictest1602426-21sh23:55:011
1433847993430,2cyclictest0-21swapper/000:15:590
1433847993427,4cyclictest1554274-21latency_hist22:55:020
1433847993427,4cyclictest0-21swapper/022:25:440
1433847993426,5cyclictest1498518-21/usr/sbin/munin21:45:500
1433847993426,4cyclictest1526100-21kworker/u8:9-rpciod23:30:430
1433847993425,6cyclictest420-21avahi-daemon23:37:180
1433847993425,6cyclictest420-21avahi-daemon23:37:180
1433847993425,5cyclictest421-21dbus-daemon23:25:010
1433847993424,7cyclictest1466915-21systemd-run21:00:020
1433847993424,5cyclictest171rcu_preempt00:10:530
1433847993419,12cyclictest1490577-21aten_r2power_fr21:35:330
1433849993325,5cyclictest1-21systemd20:30:012
1433849993324,6cyclictest1054-21mta-sts-daemon21:11:222
1433849993324,5cyclictest0-21swapper/222:10:512
1433848993325,5cyclictest1460879-21munin-run20:40:011
1433848993324,6cyclictest1433846-21cyclictest23:48:051
1433848993322,8cyclictest1457205-21needreboot20:25:441
143384799333,25cyclictest1495322-21ssh21:40:470
1433847993328,3cyclictest0-21swapper/021:30:000
1433847993327,3cyclictest0-21swapper/020:40:010
1433847993327,3cyclictest0-21swapper/019:55:020
1433847993325,5cyclictest1439863-21systemd-run19:30:020
1433849993225,3cyclictest0-21swapper/223:50:412
1433849993223,6cyclictest3838849-21cups-browsed22:07:122
1433849993223,6cyclictest1436928-21latency_hist19:20:012
1433849993223,6cyclictest1436928-21latency_hist19:20:012
1433849993221,9cyclictest1503792-21timerwakeupswit21:51:012
1433848993224,5cyclictest1446216-21aten_r2power_fr19:50:341
1433848993224,5cyclictest1439836-21sh19:30:011
1433848993223,7cyclictest1534963-21idleruntime22:30:411
1433848993222,7cyclictest1568084-21unixbench-2d23:10:581
143384899322,22cyclictest1471224-21ssh21:10:471
1433848993221,5cyclictest0-21swapper/123:55:511
143384799324,17cyclictest171rcu_preempt20:20:450
143384799324,17cyclictest171rcu_preempt20:20:450
143384799323,25cyclictest1511308-21ssh22:00:480
143384799323,24cyclictest1630263-21ssh00:30:460
1433847993225,4cyclictest1538078-21munin-plugin-st22:35:010
1433847993225,4cyclictest1444393-21munin-plugin-st19:45:010
1433847993223,6cyclictest3838849-21cups-browsed21:20:470
1433847993223,6cyclictest3838849-21cups-browsed21:20:470
1433847993222,7cyclictest1449421-21fschecks_time20:00:380
1433847993214,12cyclictest151ktimers/022:35:490
1433849993124,3cyclictest0-21swapper/223:10:472
1433849993123,5cyclictest1466908-21systemd-run21:00:012
1433849993122,6cyclictest548-21gdbus19:45:512
1433849993121,7cyclictest1442876-21munin-plugin-st19:40:022
1433848993124,4cyclictest1051-21mta-sts-daemon20:45:331
1433848993123,4cyclictest0-21swapper/120:50:491
143384799312,24cyclictest1579606-21ssh23:25:470
1433849993022,5cyclictest421-21dbus-daemon19:10:012
1433849993021,6cyclictest1469910-21true21:10:012
1433847993025,3cyclictest1422705-21kworker/u8:2+rpciod19:10:440
1433847993025,3cyclictest1422705-21kworker/u8:2+rpciod19:10:440
1433847993024,4cyclictest0-21swapper/020:50:020
143384799302,3cyclictest171rcu_preempt20:25:490
1433847993021,6cyclictest1556054-21unixbench_multi22:55:580
1433847993019,8cyclictest0-21swapper/020:10:390
1433849992922,4cyclictest0-21swapper/222:44:502
1433849992922,4cyclictest0-21swapper/222:44:502
1433849992922,3cyclictest0-21swapper/200:21:072
1433849992921,5cyclictest1465308-21grep20:50:572
1433849992921,5cyclictest1463890-21idleruntime-cro20:50:012
1433849992921,5cyclictest0-21swapper/220:10:022
143384899295,20cyclictest1614547-21ssh00:10:511
1433848992923,3cyclictest0-21swapper/119:45:011
1433848992922,4cyclictest1468393-21munin-run21:05:011
1433848992922,4cyclictest1456398-21munin-plugin-st20:25:001
1433848992922,4cyclictest1456398-21munin-plugin-st20:25:001
1433848992922,3cyclictest0-21swapper/121:30:001
1433848992922,3cyclictest0-21swapper/100:10:001
1433848992921,5cyclictest1564937-21ssh23:07:241
1433847992911,11cyclictest1530243-21cat22:25:020
1433849992823,2cyclictest0-21swapper/223:35:022
1433849992820,6cyclictest0-21swapper/219:45:012
1433849992820,5cyclictest439-21systemd-logind20:40:022
1433849992820,5cyclictest1455434-21fschecks_time20:20:372
1433849992820,5cyclictest1455434-21fschecks_time20:20:372
1433848992819,7cyclictest1594337-21latency_hist23:45:021
1433847992821,4cyclictest1448872-21awk20:00:010
143384799281,4cyclictest171rcu_preempt21:00:420
1433849992721,3cyclictest0-21swapper/219:30:022
1433849992721,3cyclictest0-21swapper/219:25:002
1433849992719,5cyclictest1458913-21processes20:30:532
143384899272,20cyclictest1055-21mta-sts-daemon19:10:481
143384899272,20cyclictest1055-21mta-sts-daemon19:10:481
1433848992720,4cyclictest1462099-21threads20:40:541
1433848992719,3cyclictest0-21swapper/122:10:461
143384799278,18cyclictest0-21swapper/020:30:520
1433847992721,3cyclictest0-21swapper/019:20:000
1433847992721,3cyclictest0-21swapper/019:20:000
1433847992720,4cyclictest1469796-21unixbench_multi21:05:570
1433847992713,12cyclictest151ktimers/020:50:460
1433849992620,3cyclictest1055-21mta-sts-daemon00:05:342
1433849992618,5cyclictest1546989-21fw_packets22:45:392
1433849992618,5cyclictest1546989-21fw_packets22:45:392
1433848992621,2cyclictest0-21swapper/121:00:011
1433847992617,6cyclictest420-21avahi-daemon19:30:340
1433849992518,4cyclictest518-21rs:main2
143384799253,15cyclictest3838849-21cups-browsed20:40:480
1433849992419,2cyclictest0-21swapper/220:45:012
1433849992416,5cyclictest1454919-21systemd-run20:20:012
1433849992413,8cyclictest1453377-21ls20:15:002
1433848992416,5cyclictest0-21swapper/120:05:361
1433847992418,4cyclictest3838849-21cups-browsed20:07:590
1433847992418,4cyclictest3838849-21cups-browsed19:23:250
143384799240,2cyclictest171rcu_preempt19:35:370
1433849992316,4cyclictest0-21swapper/219:10:442
1433849992316,4cyclictest0-21swapper/219:10:442
1433848992315,5cyclictest1469413-21proc_pri21:05:521
1433848992314,6cyclictest1444923-21fschecks_time19:45:381
1433848992314,5cyclictest0-21swapper/119:20:451
1433847992316,5cyclictest0-21swapper/019:10:010
1433848992214,6cyclictest1440416-21uniq19:30:371
1433848991812,3cyclictest0-21swapper/119:10:011
143385099172,8cyclictest0-21swapper/321:40:463
143385099161,7cyclictest0-21swapper/300:00:483
143385099152,8cyclictest0-21swapper/323:00:453
143385099152,8cyclictest0-21swapper/321:45:433
143385099152,6cyclictest0-21swapper/300:21:093
143385099151,7cyclictest0-21swapper/321:25:483
143385099151,7cyclictest0-21swapper/319:30:473
143385099151,7cyclictest0-21swapper/300:15:483
143385099151,6cyclictest0-21swapper/322:55:443
143385099151,6cyclictest0-21swapper/320:35:423
143385099142,7cyclictest0-21swapper/323:25:453
143385099142,7cyclictest0-21swapper/322:15:483
143385099142,7cyclictest0-21swapper/321:55:453
143385099142,7cyclictest0-21swapper/321:55:453
143385099142,4cyclictest0-21swapper/320:25:483
143385099141,7cyclictest0-21swapper/323:40:473
143385099141,7cyclictest0-21swapper/322:10:463
143385099141,7cyclictest0-21swapper/322:05:433
143385099141,6cyclictest0-21swapper/322:25:443
143385099141,6cyclictest0-21swapper/320:50:473
143385099133,6cyclictest0-21swapper/323:15:403
143385099132,6cyclictest0-21swapper/321:15:453
143385099132,6cyclictest0-21swapper/321:15:453
143385099132,6cyclictest0-21swapper/319:25:013
143385099131,8cyclictest0-21swapper/322:20:443
143385099131,7cyclictest0-21swapper/323:50:483
143385099131,7cyclictest0-21swapper/323:30:463
143385099131,7cyclictest0-21swapper/323:05:473
143385099131,7cyclictest0-21swapper/322:45:483
143385099131,7cyclictest0-21swapper/322:45:483
143385099131,7cyclictest0-21swapper/322:30:483
143385099131,7cyclictest0-21swapper/321:20:443
143385099131,7cyclictest0-21swapper/321:20:443
143385099131,7cyclictest0-21swapper/300:35:493
143385099131,6cyclictest0-21swapper/320:15:473
143385099131,6cyclictest0-21swapper/319:50:453
143385099131,6cyclictest0-21swapper/319:45:433
143385099131,6cyclictest0-21swapper/319:35:483
143385099131,6cyclictest0-21swapper/319:25:463
143385099131,5cyclictest0-21swapper/321:05:443
143385099131,5cyclictest0-21swapper/320:05:453
143385099131,3cyclictest0-21swapper/322:00:483
143385099123,5cyclictest0-21swapper/323:10:473
143385099122,6cyclictest0-21swapper/323:55:453
143385099122,4cyclictest0-21swapper/320:55:443
143385099121,7cyclictest0-21swapper/323:45:443
143385099121,7cyclictest0-21swapper/323:35:513
143385099121,7cyclictest0-21swapper/323:35:513
143385099121,7cyclictest0-21swapper/322:35:503
143385099121,7cyclictest0-21swapper/300:10:563
143385099121,6cyclictest0-21swapper/322:40:443
143385099121,6cyclictest0-21swapper/322:40:443
143385099121,6cyclictest0-21swapper/321:35:453
143385099121,6cyclictest0-21swapper/320:45:453
143385099121,6cyclictest0-21swapper/319:40:513
143385099121,6cyclictest0-21swapper/300:35:033
143385099121,6cyclictest0-21swapper/300:25:383
143385099113,6cyclictest0-21swapper/321:30:463
143385099112,6cyclictest0-21swapper/323:20:483
143385099112,5cyclictest0-21swapper/321:10:333
143385099111,6cyclictest0-21swapper/322:50:333
143385099111,6cyclictest0-21swapper/321:50:433
143385099111,6cyclictest0-21swapper/320:10:473
143385099111,6cyclictest0-21swapper/319:10:523
143385099111,6cyclictest0-21swapper/319:10:523
143385099111,5cyclictest0-21swapper/321:00:473
143385099111,5cyclictest0-21swapper/319:55:463
143385099101,6cyclictest0-21swapper/320:00:383
143385099101,5cyclictest0-21swapper/320:20:483
143385099101,5cyclictest0-21swapper/320:20:483
143385099101,5cyclictest0-21swapper/300:05:093
14338509993,4cyclictest0-21swapper/319:20:003
14338509993,4cyclictest0-21swapper/319:20:003
14338509991,5cyclictest0-21swapper/320:40:363
14338509991,5cyclictest0-21swapper/320:30:453
14338509981,4cyclictest0-21swapper/319:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional