You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 23:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7s.osadl.org (updated Wed Aug 26, 2026 12:42:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1246438995648,5cyclictest439-21systemd-logind12:40:022
1246437995638,15cyclictest1300787-21idleruntime-cro09:40:001
1246437995244,5cyclictest1367731-21idleruntime-cro11:30:011
1246436994924,22cyclictest420-21avahi-daemon08:26:010
1246438994840,5cyclictest1325138-21systemd-run10:20:012
1246437994535,6cyclictest1331350-21latency_hist10:30:021
1246437994535,5cyclictest0-21swapper/111:41:061
1246437994528,14cyclictest1305633-21unixbench_singl09:46:171
1246437994528,14cyclictest1305633-21unixbench_singl09:46:171
1246437994528,13cyclictest0-21swapper/110:46:111
1246436994528,12cyclictest0-21swapper/010:16:070
1246436994516,21cyclictest1387143-21ssh12:01:010
1246437994417,21cyclictest0-21swapper/110:11:031
1246436994427,14cyclictest0-21swapper/011:25:010
1246438994335,5cyclictest1398941-21fschecks_time12:20:572
1246438994334,6cyclictest1352534-21systemd-run11:05:012
124643899433,32cyclictest1292969-21ssh09:26:102
1246437994336,4cyclictest1395097-21systemd12:15:011
1246437994336,4cyclictest1395097-21systemd12:15:011
1246437994335,5cyclictest1316101-21latency_hist10:05:021
1246436994329,11cyclictest1256937-21munin-run07:45:010
1246437994223,16cyclictest1337926-21aten_r2power_po10:40:501
1246436994231,9cyclictest434882-21cups-browsed10:00:010
124643699421,34cyclictest1302054-21ntpq09:41:050
124643699421,34cyclictest1302054-21ntpq09:41:050
1246438994131,4cyclictest0-21swapper/209:01:042
1246437994133,4cyclictest0-21swapper/112:01:011
124643799411,35cyclictest1323294-21ssh10:16:031
1246436994134,4cyclictest421-21dbus-daemon08:40:010
1246436994134,4cyclictest421-21dbus-daemon08:40:010
1246436994128,10cyclictest485-21in:imuxsock08:50:000
1246436994125,13cyclictest1300793-21idleruntime-cro09:40:000
1246438994032,5cyclictest1300774-21munin-run09:40:002
1246438994031,6cyclictest1328152-21cron10:25:012
1246438994031,5cyclictest0-21swapper/209:10:012
1246438994026,10cyclictest420-21avahi-daemon10:00:532
124643799407,29cyclictest1353839-21sh11:06:081
124643799405,32cyclictest1345032-21sort10:51:131
124643799404,31cyclictest434882-21cups-browsed08:05:501
1246437994031,4cyclictest0-21swapper/111:36:011
1246437994030,6cyclictest1300761-21cron09:40:021
1246437994030,6cyclictest1300761-21cron09:40:021
1246437994023,13cyclictest0-21swapper/109:31:031
124643799402,16cyclictest1402445-21ntpq12:26:061
1246437994020,17cyclictest0-21swapper/109:00:011
124643699406,29cyclictest1001-21mta-sts-daemon08:30:590
1246436994028,9cyclictest1395162-21latency_hist12:15:020
1246436994028,9cyclictest1395162-21latency_hist12:15:020
1246436994025,12cyclictest1263447-21fschecks_count08:05:550
1246436994021,17cyclictest434882-21cups-browsed11:17:550
124643699401,3cyclictest1375042-21ntpq11:41:030
124643699401,14cyclictest1344680-21ntpq10:51:070
124643699401,12cyclictest1354722-21ssh11:07:250
1246437993931,5cyclictest1364702-21munin-plugin-st11:25:011
1246437993922,14cyclictest1249424-21sendmail07:20:001
1246437993922,13cyclictest0-21swapper/110:56:081
1246436993932,4cyclictest0-21swapper/010:36:060
124643699391,34cyclictest1295894-21ssh09:31:020
124643899386,25cyclictest434882-21cups-browsed12:26:002
124643899383,25cyclictest1387266-21ssh12:01:062
1246438993831,4cyclictest1003-21mta-sts-daemon11:44:182
1246438993831,3cyclictest0-21swapper/211:15:012
1246438993828,7cyclictest421-21dbus-daemon11:38:062
124643799388,26cyclictest420-21avahi-daemon10:37:561
1246437993830,5cyclictest1288553-21sendmail09:20:011
1246437993829,6cyclictest434877-21cupsd10:09:181
1246437993828,7cyclictest1380926-21missed_timers11:51:001
124643799382,14cyclictest1277315-21ntpq08:51:031
1246437993816,19cyclictest0-21swapper/112:36:021
124643799381,32cyclictest443-21gpm12:08:361
124643799381,32cyclictest443-21gpm12:08:361
124643799381,16cyclictest1269951-21ps08:26:081
1246437993811,24cyclictest1251776-21nfs_client07:25:591
124643699382,31cyclictest1292851-21ntpq09:26:050
1246436993822,12cyclictest0-21swapper/010:21:040
124643699381,13cyclictest1384046-21ntpq11:56:000
124643699381,13cyclictest1368373-21ssh11:30:510
124643699381,13cyclictest1349802-21ssh11:00:190
124643699381,13cyclictest1348946-21ssh10:58:250
124643699381,12cyclictest1407503-21ssh12:35:110
1246438993730,3cyclictest0-21swapper/212:06:022
1246438993730,3cyclictest0-21swapper/212:06:022
1246438993729,5cyclictest1332526-21ssh10:31:092
1246438993729,5cyclictest0-21swapper/210:55:012
1246438993729,4cyclictest0-21swapper/211:06:052
1246438993728,6cyclictest1319175-21latency_hist10:10:022
1246438993727,7cyclictest1398100-21/usr/sbin/munin12:20:012
124643799379,25cyclictest0-21swapper/109:21:001
124643799373,29cyclictest1356827-21ssh11:11:051
1246437993730,4cyclictest1359398-21cut11:15:551
1246437993729,5cyclictest420-21avahi-daemon10:00:011
124643799371,5cyclictest1250354-21ntpq07:21:051
124643799371,14cyclictest1405547-21ps12:31:081
124643799371,13cyclictest1275906-21ntpq08:46:051
124643699373,28cyclictest1399433-21ntp_states12:21:090
1246436993730,5cyclictest1282416-21diskmemload12:05:510
1246436993730,5cyclictest1282416-21diskmemload12:05:510
124643699372,29cyclictest1254776-21ntpq07:36:030
1246436993721,13cyclictest1370901-21kworker/u8:1-rpciod11:45:530
124643699371,7cyclictest1251810-21ntpq07:26:000
1246436993717,18cyclictest1300822-21kworker/u8:8+nfsiod10:31:130
124643699371,33cyclictest1267377-21vmstat08:16:160
124643699371,29cyclictest1259439-21ps07:51:080
124643699371,22cyclictest1313462-21aten2.4-expect10:00:510
124643699371,10cyclictest1265322-21ntpq08:11:030
1246438993627,5cyclictest420-21avahi-daemon10:41:142
1246438993625,7cyclictest1380970-21needreboot11:51:012
124643899361,28cyclictest1335436-21sh10:36:032
1246438993610,20cyclictest428-21mta-sts-daemon09:11:032
1246437993629,4cyclictest1398086-21ssh12:20:001
124643799362,7cyclictest1266789-21ntpq08:16:041
124643799362,15cyclictest1332483-21ntpq10:31:071
1246437993618,14cyclictest0-21swapper/109:30:021
124643799361,28cyclictest420-21avahi-daemon11:04:521
124643799361,12cyclictest1308023-21ntpq09:51:041
124643799361,12cyclictest1308023-21ntpq09:51:041
1246437993611,22cyclictest420-21avahi-daemon10:21:111
1246437993610,23cyclictest567-21gdbus08:15:011
1246437993610,23cyclictest1280876-21uptime09:01:131
124643699362,28cyclictest1253289-21ntpq07:31:010
1246436993621,12cyclictest1001-21mta-sts-daemon10:45:070
124643699361,9cyclictest1280833-21/usr/sbin/munin09:01:130
1246436993616,18cyclictest1403171-21sshd12:26:490
1246436993616,17cyclictest0-21swapper/010:26:010
1246436993615,18cyclictest0-21swapper/010:45:010
124643699361,4cyclictest1250337-21ntpq07:21:050
124643699361,30cyclictest1286756-21ntpq09:16:070
124643699361,12cyclictest1356451-21awk11:10:560
124643699361,12cyclictest1304767-21/usr/sbin/munin09:45:590
124643699361,12cyclictest1304767-21/usr/sbin/munin09:45:590
124643699361,12cyclictest1281848-21ntpq09:06:040
124643699361,12cyclictest1277304-21ntpq08:51:020
124643699361,11cyclictest1283589-21ntpq09:11:030
124643699360,3cyclictest1365721-21ssh11:25:570
124643699360,12cyclictest1318189-21ssh10:07:250
124643699360,11cyclictest1321671-21ssh10:13:500
1246438993527,5cyclictest1291605-21cron09:25:012
124643899352,26cyclictest1311233-21ssh09:56:102
124643799358,25cyclictest0-21swapper/107:45:581
124643799356,26cyclictest421-21dbus-daemon07:41:031
1246437993528,4cyclictest1000-21mta-sts-daemon08:01:011
124643799352,6cyclictest1254886-21ntpq07:36:091
124643799351,4cyclictest427-21polkitd11:56:261
1246437993513,19cyclictest0-21swapper/111:45:531
124643799351,11cyclictest1399399-21ntpq12:21:071
124643799351,10cyclictest1272806-21ntpq08:36:031
124643799351,10cyclictest1272806-21ntpq08:36:031
124643699354,26cyclictest1405330-21ntpq12:31:000
124643699353,28cyclictest428-21mta-sts-daemon07:56:070
124643699352,28cyclictest1307628-21diskstats09:50:560
124643699352,28cyclictest1307628-21diskstats09:50:560
124643699351,5cyclictest1380689-21fw_packets11:50:570
1246436993514,18cyclictest0-21swapper/012:15:580
124643699351,10cyclictest1274347-21ntpq08:41:030
124643699351,10cyclictest1248899-21ntpq07:16:100
1246438993427,4cyclictest1363997-21kworker/u8:12-xprtiod11:35:022
1246438993425,6cyclictest1273448-21systemd-run08:40:012
1246438993425,6cyclictest1273448-21systemd-run08:40:012
124643899341,5cyclictest171rcu_preempt08:56:032
1246438993414,15cyclictest420-21avahi-daemon07:41:042
124643799349,22cyclictest420-21avahi-daemon08:21:091
124643799349,21cyclictest1368319-21sh11:30:501
124643799341,13cyclictest1253318-21ntpq07:31:021
124643799341,11cyclictest1274274-21ntpq08:41:001
124643799341,11cyclictest1247341-21ntpq07:11:031
124643799341,10cyclictest1271905-21sshd08:34:491
124643799341,10cyclictest1260748-21awk07:56:031
124643699343,19cyclictest1372024-21ntpq11:36:050
124643699342,5cyclictest1247285-21ntpq07:11:010
124643699342,27cyclictest1289724-21ntpq09:21:010
124643699341,8cyclictest1257913-21ntpq07:46:070
124643699341,11cyclictest1278639-21memory08:55:590
124643699340,10cyclictest1262051-21modprobe08:00:560
1246438993328,2cyclictest0-21swapper/207:20:002
1246438993327,3cyclictest0-21swapper/210:30:022
1246438993327,3cyclictest0-21swapper/208:45:012
1246438993326,4cyclictest1269829-21ntpq08:26:022
1246438993326,4cyclictest1252949-21fschecks_count07:30:542
1246438993326,3cyclictest0-21swapper/209:55:022
1246438993326,3cyclictest0-21swapper/209:55:022
1246438993322,8cyclictest1259917-21munin-plugin-st07:55:012
1246437993312,18cyclictest0-21swapper/109:10:011
124643799331,11cyclictest1259294-21ntpq07:51:011
124643799331,10cyclictest1283273-21if_err_eth009:10:581
124643699332,5cyclictest1268345-21ntpq08:21:040
1246438993226,3cyclictest0-21swapper/210:15:012
1246438993223,6cyclictest1247852-21unixbench_singl07:11:132
124643899322,23cyclictest1286682-21ssh09:16:042
1246438993220,9cyclictest1271321-21ntp_kernel_pll_08:31:022
1246438993214,11cyclictest0-21swapper/211:46:042
1246438993120,8cyclictest1251779-21ntp_kernel_err07:25:592
124643899311,23cyclictest1295961-21rm09:31:052
124643799311,5cyclictest1246449-21unin-run07:10:011
124643799311,5cyclictest1246449-21unin-run07:10:011
124643699311,2cyclictest0-21swapper/007:10:010
124643699311,2cyclictest0-21swapper/007:10:010
124643899305,19cyclictest1003-21mta-sts-daemon08:16:062
1246438993022,5cyclictest1302169-21proc_pri09:41:092
1246438993022,5cyclictest1302169-21proc_pri09:41:092
1246438993015,11cyclictest1003-21mta-sts-daemon07:21:042
124643899293,18cyclictest1365897-21ssh11:26:012
1246438992924,2cyclictest0-21swapper/212:15:002
1246438992924,2cyclictest0-21swapper/212:15:002
1246438992923,2cyclictest0-21swapper/211:00:012
124643899292,20cyclictest1341508-21ssh10:46:032
1246438992921,5cyclictest0-21swapper/208:15:012
1246438992822,3cyclictest0-21swapper/207:40:012
124643899282,20cyclictest1304870-21memory09:46:002
124643899282,20cyclictest1304870-21memory09:46:002
1246438992821,4cyclictest1263453-21fschecks_count08:05:552
124643899281,21cyclictest1362864-21sh11:21:032
1246438992719,5cyclictest1-21systemd08:05:012
1246438992717,7cyclictest1261345-21unixbench_singl07:56:172
124643899263,18cyclictest1405369-21ssh12:31:012
1246438992622,2cyclictest0-21swapper/207:50:012
124643899262,19cyclictest1359762-21ssh11:16:012
1246438992621,2cyclictest0-21swapper/211:55:512
1246438992619,4cyclictest1268205-21missed_timers08:20:592
1246438992616,7cyclictest1276418-21idleruntime-cro08:50:002
1246438992315,5cyclictest1276716-21tail08:50:522
1246438992216,3cyclictest0-21swapper/207:10:012
1246438992216,3cyclictest0-21swapper/207:10:012
124643999174,6cyclictest0-21swapper/310:11:073
124643999172,7cyclictest0-21swapper/311:56:003
124643999171,8cyclictest0-21swapper/312:06:003
124643999171,8cyclictest0-21swapper/312:06:003
124643999161,8cyclictest0-21swapper/311:21:023
124643999153,6cyclictest0-21swapper/309:56:073
124643999152,7cyclictest0-21swapper/312:21:103
124643999152,7cyclictest0-21swapper/312:16:043
124643999152,7cyclictest0-21swapper/309:16:043
124643999152,6cyclictest0-21swapper/311:46:033
124643999152,6cyclictest0-21swapper/307:56:083
124643999151,8cyclictest0-21swapper/310:51:023
124643999151,7cyclictest0-21swapper/311:11:003
124643999151,7cyclictest0-21swapper/309:51:043
124643999151,7cyclictest0-21swapper/309:51:043
124643999151,7cyclictest0-21swapper/307:46:003
124643999151,6cyclictest0-21swapper/308:21:043
124643999151,5cyclictest0-21swapper/309:06:003
124643999144,7cyclictest0-21swapper/310:30:553
124643999143,6cyclictest0-21swapper/312:26:053
124643999143,5cyclictest0-21swapper/312:31:023
124643999143,5cyclictest0-21swapper/307:51:053
124643999143,4cyclictest0-21swapper/308:41:053
124643999142,6cyclictest0-21swapper/310:25:273
124643999142,5cyclictest0-21swapper/307:36:033
124643999141,7cyclictest0-21swapper/311:51:043
124643999141,7cyclictest0-21swapper/310:16:053
124643999141,6cyclictest0-21swapper/310:46:043
124643999141,6cyclictest0-21swapper/310:06:023
124643999141,6cyclictest0-21swapper/308:36:053
124643999141,6cyclictest0-21swapper/308:36:053
124643999134,6cyclictest0-21swapper/309:36:103
124643999133,6cyclictest0-21swapper/311:01:103
124643999133,6cyclictest0-21swapper/308:06:023
124643999132,7cyclictest0-21swapper/311:40:533
124643999132,7cyclictest0-21swapper/310:01:003
124643999132,6cyclictest0-21swapper/312:11:083
124643999132,6cyclictest0-21swapper/312:11:083
124643999132,6cyclictest0-21swapper/309:21:053
124643999132,6cyclictest0-21swapper/308:26:083
124643999132,5cyclictest0-21swapper/308:31:033
124643999131,7cyclictest0-21swapper/311:36:023
124643999131,7cyclictest0-21swapper/311:31:013
124643999131,7cyclictest0-21swapper/311:06:043
124643999131,7cyclictest0-21swapper/310:21:033
124643999131,7cyclictest0-21swapper/309:41:073
124643999131,7cyclictest0-21swapper/309:41:073
124643999131,6cyclictest0-21swapper/308:45:593
124643999131,6cyclictest0-21swapper/308:16:033
124643999131,6cyclictest0-21swapper/308:01:023
124643999123,7cyclictest0-21swapper/310:35:593
124643999123,6cyclictest0-21swapper/310:56:003
124643999122,6cyclictest0-21swapper/309:25:563
124643999121,8cyclictest0-21swapper/309:30:593
124643999121,7cyclictest0-21swapper/312:35:543
124643999121,7cyclictest0-21swapper/311:26:033
124643999121,7cyclictest0-21swapper/311:16:013
124643999121,6cyclictest0-21swapper/309:01:073
124643999114,3cyclictest0-21swapper/307:26:023
124643999112,6cyclictest0-21swapper/308:51:023
124643999112,5cyclictest0-21swapper/312:00:503
124643999112,4cyclictest0-21swapper/307:21:033
124643999111,7cyclictest0-21swapper/309:46:003
124643999111,7cyclictest0-21swapper/309:46:003
124643999111,6cyclictest0-21swapper/307:31:013
124643999111,5cyclictest0-21swapper/309:10:473
124643999104,3cyclictest0-21swapper/307:11:023
124643999102,4cyclictest0-21swapper/307:16:043
124643999101,6cyclictest0-21swapper/310:40:533
124643999101,6cyclictest0-21swapper/307:40:543
124643999101,6cyclictest0-21swapper/307:10:013
124643999101,6cyclictest0-21swapper/307:10:013
124643999101,5cyclictest0-21swapper/309:00:033
12464399991,5cyclictest0-21swapper/308:10:523
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional