You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 13:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Wed Apr 08, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1391104995445,5cyclictest1412102-21idleruntime-cro20:10:001
1391113995243,6cyclictest1418929-21idleruntime-cro20:30:003
1391099995040,5cyclictest1498222-21idleruntime-cro00:20:000
1391113994734,9cyclictest391ktimers/322:45:123
1391113994734,9cyclictest391ktimers/322:45:113
1391113994426,15cyclictest0-21swapper/322:55:003
1391113994426,15cyclictest0-21swapper/322:55:003
1391108994423,16cyclictest0-21swapper/223:46:542
1391108994422,18cyclictest0-21swapper/221:05:162
1391113994333,6cyclictest0-21swapper/320:00:013
1391113994333,6cyclictest0-21swapper/320:00:003
1391099994332,7cyclictest1418436-21grep20:25:270
139111399421,9cyclictest1457914-21/usr/sbin/munin22:20:213
139111399421,9cyclictest1444401-21/usr/sbin/munin21:40:233
1391113994218,21cyclictest0-21swapper/320:00:253
1391113994210,29cyclictest1414713-21/usr/sbin/munin20:15:243
1391113994210,29cyclictest1414713-21/usr/sbin/munin20:15:233
139110899422,9cyclictest1405693-21fschecks_time19:50:162
1391108994221,18cyclictest0-21swapper/220:55:012
1391099994233,6cyclictest1466844-21unixbench_multi22:45:240
1391099994233,6cyclictest1466844-21unixbench_multi22:45:240
1391113994129,8cyclictest391ktimers/323:15:123
139111399411,8cyclictest1428840-21sshd20:56:303
1391113994113,25cyclictest0-21swapper/300:25:233
1391113994112,26cyclictest1429769-21fschecks_count21:00:143
1391108994133,4cyclictest1403567-21cron19:45:012
1391108994128,9cyclictest0-21swapper/221:35:262
139110899411,9cyclictest1439623-21grep21:25:262
1391108994110,6cyclictest1478959-21seq23:21:422
1391104994130,8cyclictest1484147-21grep23:35:261
139111399407,6cyclictest1474809-21missed_timers23:10:203
139111399402,5cyclictest1471714-21/usr/sbin/munin23:00:243
139111399401,9cyclictest1480390-21/usr/sbin/munin23:25:263
139111399401,9cyclictest1469762-21/usr/sbin/munin22:55:203
139111399401,9cyclictest1455900-21/usr/sbin/munin22:15:153
139111399401,9cyclictest1436760-21df_inode21:20:153
139111399401,9cyclictest1421610-21/usr/sbin/munin20:35:233
139111399401,7cyclictest1483764-21/usr/sbin/munin23:35:223
139111399401,7cyclictest1478712-21sed23:20:253
139111399401,7cyclictest1451172-21/usr/sbin/munin22:00:223
139111399401,7cyclictest1433458-21/usr/sbin/munin21:10:203
139111399401,11cyclictest1461714-21grep22:30:253
1391108994011,3cyclictest0-21swapper/200:35:232
1391108994010,5cyclictest1468263-21/usr/sbin/munin22:50:222
1391108994010,5cyclictest1468263-21/usr/sbin/munin22:50:222
1391104994031,5cyclictest1401860-21munin-plugin-st19:40:011
139111399393,9cyclictest1498890-21/usr/sbin/munin00:20:153
1391113993932,4cyclictest0-21swapper/319:45:003
139111399391,9cyclictest1439129-21/usr/sbin/munin21:25:213
139111399391,9cyclictest1416523-21/usr/sbin/munin20:20:243
139111399391,9cyclictest1416523-21/usr/sbin/munin20:20:243
139111399391,8cyclictest629-21snmpd22:35:573
139111399391,8cyclictest1404254-21/usr/sbin/munin19:45:193
139111399391,8cyclictest1404254-21/usr/sbin/munin19:45:193
139111399391,7cyclictest1459157-21/usr/sbin/munin22:25:163
139111399391,6cyclictest1492608-21/usr/sbin/munin00:00:263
139111399391,6cyclictest1481994-21/usr/sbin/munin23:30:203
139111399391,6cyclictest1427406-21sshd20:54:443
1391113993913,23cyclictest1411621-21sed20:05:253
1391113993912,23cyclictest1486747-21ls23:45:163
1391113993910,26cyclictest1397498-21date19:25:223
1391113993910,26cyclictest0-21swapper/321:30:193
1391113993910,26cyclictest0-21swapper/300:30:193
139110899398,5cyclictest0-21swapper/200:25:172
1391108993929,6cyclictest0-21swapper/223:35:002
139110899391,12cyclictest1489688-21grep23:55:002
139110899391,10cyclictest1457324-21apt-get22:20:132
1391108993910,3cyclictest0-21swapper/219:10:182
1391104993928,6cyclictest0-21swapper/123:30:011
1391099993927,8cyclictest1468606-21grep22:50:250
1391099993927,8cyclictest1468606-21grep22:50:250
139111399388,3cyclictest0-21swapper/321:15:253
139111399384,31cyclictest1485181-21/usr/sbin/munin23:40:183
139111399382,4cyclictest1424850-21/usr/sbin/munin20:45:223
139111399381,9cyclictest1488445-21/usr/sbin/munin23:50:173
139111399381,9cyclictest1464692-21awk22:40:203
139111399381,9cyclictest1446954-21cat21:50:013
139111399381,9cyclictest1399291-21/usr/sbin/munin19:30:243
139111399381,7cyclictest1432028-21/usr/sbin/munin21:05:233
139111399381,6cyclictest1391371-21df_inode19:10:143
1391113993814,21cyclictest14003792sleep319:35:103
139111399381,10cyclictest1443037-21users21:35:273
139110899389,5cyclictest1433336-21/usr/sbin/munin21:10:172
139110899389,5cyclictest0-21swapper/222:45:232
139110899389,5cyclictest0-21swapper/222:45:232
139110899383,10cyclictest1445614-21perl21:45:162
1391108993825,9cyclictest311ktimers/221:15:112
1391108993814,21cyclictest0-21swapper/221:31:372
1391108993813,3cyclictest0-21swapper/222:30:212
139110899381,11cyclictest1449460-21gunzip21:55:222
139110899381,10cyclictest1502483-21wc00:30:222
139110899381,10cyclictest1455759-21cut22:15:142
1391104993829,5cyclictest0-21swapper/121:00:001
1391104993829,5cyclictest0-21swapper/120:26:271
1391104993828,6cyclictest0-21swapper/121:40:011
1391099993829,6cyclictest1424036-21cron20:45:010
1391099993827,7cyclictest1503321-21debian-sa100:35:010
1391113993729,4cyclictest1424041-21kthreadd20:45:013
139111399372,4cyclictest1393744-21grep19:15:163
139111399371,9cyclictest1447080-21apt-get21:50:083
139111399371,7cyclictest629-21snmpd00:06:163
139111399371,10cyclictest1396220-21sed19:20:253
139111399370,9cyclictest1405957-21/usr/sbin/munin19:50:193
139110899379,3cyclictest0-21swapper/219:35:252
139110899378,5cyclictest0-21swapper/221:20:212
139110899371,9cyclictest1498197-21cron00:20:012
139110899371,8cyclictest1485853-21head23:40:242
1391108993712,4cyclictest311ktimers/223:55:192
1391108993712,4cyclictest311ktimers/223:55:182
1391108993711,6cyclictest1448546-21sh21:55:012
139110899371,11cyclictest1451071-21ntp_states22:00:202
1391104993728,6cyclictest204-21dbus-daemon19:26:161
1391099993724,8cyclictest1406965-21cron19:55:010
1391099993723,10cyclictest121ktimers/019:40:140
139111399363,6cyclictest1503803-21idleruntime00:35:193
139111399361,6cyclictest1473335-21gunzip23:05:233
1391113993612,21cyclictest1490074-21fschecks_count23:55:153
1391113993612,21cyclictest1490074-21fschecks_count23:55:153
139111399361,12cyclictest1454462-21ntp_states22:10:203
139110899369,3cyclictest1414779-21sh20:15:242
139110899369,3cyclictest1414779-21sh20:15:242
139110899362,7cyclictest1394570-21grep19:15:242
1391108993627,6cyclictest1469405-21fschecks_count22:55:162
1391108993626,6cyclictest1412541-21fschecks_time20:10:162
1391108993626,6cyclictest1412541-21fschecks_time20:10:162
1391108993613,20cyclictest1484559-21latency_hist23:40:012
1391108993612,3cyclictest1454106-21fschecks_time22:10:152
139110899361,11cyclictest1444242-21ntp_states21:40:212
1391104993628,4cyclictest1403576-21audit_send_reply19:45:011
1391104993627,6cyclictest0-21swapper/123:49:591
1391104993627,5cyclictest1436417-21idleruntime-cro21:20:001
1391104993626,5cyclictest1440030-21idleruntime-cro21:30:011
1391104993625,7cyclictest1426982-21grep20:50:251
1391099993629,4cyclictest1491378-21sh23:59:590
1391099993629,4cyclictest1491378-21sh00:00:000
1391099993626,6cyclictest1456635-21grep22:15:230
1391099993625,7cyclictest1420194-21grep20:30:250
1391099993624,8cyclictest1395055-21sendmail19:20:010
139111399353,5cyclictest0-21swapper/300:19:593
139111399351,9cyclictest1495430-21/usr/sbin/munin00:10:183
139111399351,8cyclictest1452645-21/usr/sbin/munin22:05:193
139111399351,6cyclictest1419306-21grep20:30:163
1391113993511,21cyclictest0-21swapper/320:10:123
1391113993511,21cyclictest0-21swapper/320:10:123
139110899359,6cyclictest1476615-21/usr/sbin/munin23:15:202
139110899358,6cyclictest0-21swapper/220:55:252
139110899352,9cyclictest1399601-21cat19:30:262
1391108993523,9cyclictest311ktimers/219:20:132
139110899351,9cyclictest1493471-21cut00:05:162
1391108993511,5cyclictest311ktimers/220:30:162
139110899351,10cyclictest1453677-21grep22:10:002
139110899349,4cyclictest1459208-21fschecks_time22:25:182
139110899347,7cyclictest1495566-21tr00:10:202
139110899341,9cyclictest1425325-21unixbench_singl20:45:252
139110899341,9cyclictest1408683-21sendmail20:00:012
139110899341,9cyclictest1408683-21sendmail20:00:012
139110899341,8cyclictest1409983-21unixbench_singl20:00:252
1391108993414,17cyclictest0-21swapper/220:10:002
139110899341,11cyclictest1423634-21head20:40:252
139110899341,11cyclictest1416799-21grep20:20:252
139110899341,11cyclictest1416799-21grep20:20:252
1391104993426,4cyclictest0-21swapper/122:15:201
1391104993425,5cyclictest0-21swapper/123:56:561
1391104993425,5cyclictest0-21swapper/123:56:561
1391104993425,5cyclictest0-21swapper/123:31:501
1391099993427,5cyclictest1451643-21kworker/u8:1+events_unbound23:11:510
1391099993424,6cyclictest0-21swapper/023:30:000
139111399331,7cyclictest1448834-21/usr/sbin/munin21:55:113
139110899331,9cyclictest1472426-21apt23:05:002
1391108993315,14cyclictest0-21swapper/223:05:252
139110899331,11cyclictest1464706-21ntp_states22:40:212
139110899331,11cyclictest1430050-21meminfo21:00:192
1391108993310,3cyclictest0-21swapper/219:45:222
1391108993310,3cyclictest0-21swapper/219:45:212
1391104993325,5cyclictest0-21swapper/121:50:231
1391104993323,6cyclictest0-21swapper/120:15:261
1391104993323,6cyclictest0-21swapper/120:15:261
1391099993325,4cyclictest1496500-21debian-sa100:15:010
1391099993325,4cyclictest0-21swapper/019:20:260
1391099993323,6cyclictest11-21ksoftirqd/000:25:130
1391099993323,6cyclictest0-21swapper/021:40:250
1391099993322,8cyclictest1413789-21sh20:15:000
1391099993322,8cyclictest1413789-21sh20:15:000
139109999330,5cyclictest0-21swapper/000:05:120
1391108993222,6cyclictest0-21swapper/220:25:272
1391104993224,4cyclictest0-21swapper/119:50:151
1391104993222,6cyclictest1395040-21munin-run19:20:011
1391104993222,6cyclictest0-21swapper/121:24:591
1391099993225,5cyclictest1401817-21kworker/u8:3+events_unbound20:06:250
1391099993225,4cyclictest0-21swapper/023:45:160
1391099993224,4cyclictest0-21swapper/021:25:250
1391099993220,9cyclictest13550irq/42-30be0000.ethernet20:15:120
1391099993220,9cyclictest13550irq/42-30be0000.ethernet20:15:120
1391099993220,7cyclictest0-21swapper/021:35:270
1391099993220,6cyclictest0-21swapper/020:00:000
1391099993220,6cyclictest0-21swapper/020:00:000
1391099993215,14cyclictest11-21ksoftirqd/000:35:150
139110899319,5cyclictest311ktimers/223:10:122
139110899318,3cyclictest0-21swapper/223:30:012
1391108993122,6cyclictest0-21swapper/222:35:152
1391104993124,4cyclictest0-21swapper/123:50:241
1391099993123,4cyclictest1460708-21kworker/u8:0+events_unbound22:31:480
1391099993119,9cyclictest121ktimers/021:45:120
1391108993010,7cyclictest1421347-21sed20:35:202
1391104993022,4cyclictest0-21swapper/123:05:261
1391099993022,5cyclictest1463923-21idleruntime-cro22:40:000
1391099993022,4cyclictest0-21swapper/000:00:260
1391104992921,5cyclictest1496073-21grep00:10:241
1391104992920,5cyclictest0-21swapper/122:10:141
1391104992919,6cyclictest0-21swapper/100:30:011
1391099992918,7cyclictest1398038-21unixbench_singl19:25:270
1391104992822,3cyclictest0-21swapper/122:55:101
1391104992820,4cyclictest0-21swapper/122:05:011
1391099992820,4cyclictest0-21swapper/022:55:250
1391099992819,7cyclictest121ktimers/023:30:050
1391099992812,14cyclictest121ktimers/021:35:010
1391104992719,4cyclictest0-21swapper/121:00:151
1391104992718,6cyclictest0-21swapper/122:45:251
1391104992718,6cyclictest0-21swapper/122:45:251
1391104992716,8cyclictest1460090-21grep22:25:271
139109999273,7cyclictest1477541-21idleruntime-cro23:20:010
1391099992719,5cyclictest0-21swapper/022:00:250
139109999271,23cyclictest1416420-21ps20:20:230
139109999271,23cyclictest1416420-21ps20:20:230
139109999271,10cyclictest1450276-21awk22:00:000
1391104992616,7cyclictest1425262-21grep20:45:251
1391099992619,4cyclictest1425741-21sh20:50:010
1391099992617,6cyclictest0-21swapper/022:40:160
1391099992616,7cyclictest1438197-21ls21:25:010
1391108992517,5cyclictest0-21swapper/200:00:252
1391104992518,5cyclictest231ktimers/122:40:111
1391104992517,4cyclictest0-21swapper/122:35:161
1391104992516,6cyclictest1404811-21unixbench_multi19:45:251
1391104992516,6cyclictest1404811-21unixbench_multi19:45:241
1391104992515,7cyclictest1446380-21grep21:45:241
139109999259,6cyclictest1441551-21kworker/u8:2+events_unbound22:09:380
139109999253,5cyclictest1432362-21grep21:05:260
1391099992519,3cyclictest13850irq/36-mmc120:40:000
1391099992516,6cyclictest0-21swapper/021:15:010
1391099992515,7cyclictest1404383-21ntpq19:45:220
1391099992515,7cyclictest1404383-21ntpq19:45:220
1391104992415,6cyclictest1460861-21fschecks_count22:30:151
1391104992415,5cyclictest0-21swapper/123:05:001
1391104992415,5cyclictest0-21swapper/100:05:251
1391104992414,6cyclictest0-21swapper/119:10:191
1391104992412,9cyclictest1422701-21awk20:40:161
139109999242,14cyclictest1448548-21debian-sa121:55:000
1391099992417,5cyclictest1477150-21kworker/u8:0+events_unbound23:36:530
1391099992417,4cyclictest13850irq/36-mmc122:30:010
1391099992415,6cyclictest0-21swapper/020:00:260
1391099992414,7cyclictest1400145-21cron19:35:000
139109999241,20cyclictest1400504-21chrt19:35:140
139109999241,19cyclictest1427434-21cron20:55:010
139109999241,19cyclictest0-21swapper/020:59:410
1391108992311,8cyclictest1-21systemd00:22:012
1391104992317,3cyclictest0-21swapper/123:10:211
1391104992317,3cyclictest0-21swapper/120:35:231
1391104992316,5cyclictest1429041-21kworker/u8:0+events_unbound21:05:051
1391104992316,4cyclictest0-21swapper/121:30:241
1391104992316,4cyclictest0-21swapper/119:20:251
1391104992315,5cyclictest0-21swapper/100:15:241
1391104992315,4cyclictest0-21swapper/121:40:241
1391104992313,7cyclictest1457882-21ntpq22:20:211
1391104992313,7cyclictest1412721-21sed20:10:181
1391104992313,7cyclictest1412721-21sed20:10:181
1391099992317,3cyclictest0-21swapper/023:00:190
1391099992317,2cyclictest0-21swapper/000:20:210
1391099992314,5cyclictest0-21swapper/021:01:500
139109999230,19cyclictest0-21swapper/023:23:420
139109999230,19cyclictest0-21swapper/019:12:570
1391104992216,3cyclictest0-21swapper/121:15:011
1391104992216,3cyclictest0-21swapper/120:30:131
1391104992216,3cyclictest0-21swapper/100:30:251
1391104992214,5cyclictest231ktimers/123:20:151
1391099992215,5cyclictest121ktimers/023:40:210
1391099992215,3cyclictest0-21swapper/021:17:210
139109999221,2cyclictest0-21swapper/022:14:250
139109999221,19cyclictest0-21swapper/023:06:430
1391108992114,4cyclictest1397147-21fschecks_count19:25:172
1391104992116,3cyclictest0-21swapper/123:40:111
1391104992115,4cyclictest1476241-21fschecks_time23:15:161
1391104992112,6cyclictest0-21swapper/120:00:161
1391099992115,2cyclictest0-21swapper/023:50:140
1391104992014,3cyclictest0-21swapper/100:35:201
1391104992013,4cyclictest1452336-21fschecks_count22:05:161
139110499201,15cyclictest1399707-21unixbench_multi19:30:271
139109999200,18cyclictest0-21swapper/022:21:180
139110499199,8cyclictest1407444-21fw_packets19:55:181
139110499199,8cyclictest1407444-21fw_packets19:55:181
1391104991913,3cyclictest0-21swapper/100:20:221
1391104991912,5cyclictest231ktimers/100:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional