You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 17:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Wed Mar 18, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1396183995645,7cyclictest1508427-21unixbench_singl12:30:240
1396183995042,4cyclictest1410370-21munin-plugin-st07:50:010
1396189994733,10cyclictest311ktimers/209:30:112
1396194994640,4cyclictest1410857-21kworker/u8:0+events_unbound09:45:073
1396186994631,12cyclictest1427643-21sendmail08:40:011
1396189994538,5cyclictest1497053-21kworker/u8:1+events_unbound12:13:422
139618699451,4cyclictest0-21swapper/112:05:111
1396186994435,5cyclictest1483042-21sendmail11:20:011
1396186994431,10cyclictest231ktimers/110:35:121
139619499422,5cyclictest131rcu_preempt12:15:143
1396186994230,8cyclictest231ktimers/107:35:101
139618699421,9cyclictest1410934-21/usr/sbin/munin07:50:191
139618699421,9cyclictest1399334-21/usr/sbin/munin07:15:251
139618699421,36cyclictest1397376-21head07:10:261
1396186994212,25cyclictest231ktimers/108:10:021
1396183994235,4cyclictest1444677-21cron09:30:000
1396183994227,11cyclictest121ktimers/010:05:110
139618699411,9cyclictest1500859-21/usr/sbin/munin12:10:211
139618699411,9cyclictest1434687-21/usr/sbin/munin09:00:251
139619499401,5cyclictest131rcu_preempt12:05:113
1396189994033,5cyclictest1486095-21kworker/u8:2+events_unbound11:33:382
1396189994033,5cyclictest1439352-21kworker/u8:1+events_unbound09:28:122
1396189994033,4cyclictest0-21swapper/210:50:002
1396189994033,4cyclictest0-21swapper/210:50:002
139618699403,34cyclictest1408999-21df07:45:141
139618699401,9cyclictest1462755-21/usr/sbin/munin10:20:201
139618699401,8cyclictest1470920-21/usr/sbin/munin10:45:251
139618699401,8cyclictest1470920-21/usr/sbin/munin10:45:241
139618699401,5cyclictest1504073-21/usr/sbin/munin12:20:131
139618699401,4cyclictest1490224-21/usr/sbin/munin11:40:141
139618699401,3cyclictest0-21swapper/111:30:121
139618699401,3cyclictest0-21swapper/109:05:111
139618699401,3cyclictest0-21swapper/108:10:121
139618699401,34cyclictest1469340-21/usr/sbin/munin10:40:131
139618699401,10cyclictest1429678-21df08:45:151
1396194993933,4cyclictest1459886-21kworker/u8:3+events_unbound10:33:303
1396186993930,5cyclictest1445920-21unixbench_multi09:30:251
1396186993928,8cyclictest438-21cron09:50:001
139618699391,8cyclictest1493510-21/usr/sbin/munin11:50:121
139618699391,8cyclictest1465179-21users10:25:251
139618699391,8cyclictest1432289-21/usr/sbin/munin08:50:261
139618699391,6cyclictest1483878-21/usr/sbin/munin11:20:211
139618699391,6cyclictest1447290-21/usr/sbin/munin09:35:231
139618699391,5cyclictest1496797-21latency_hist12:00:001
139618699391,5cyclictest1496797-21latency_hist12:00:001
139618699391,5cyclictest1485095-21/usr/sbin/munin11:25:131
139618699391,5cyclictest1401793-21sshd07:24:321
139618699391,4cyclictest1479984-21diskstats11:10:161
139618699391,3cyclictest0-21swapper/111:45:141
1396186993911,26cyclictest1419324-21/usr/sbin/munin08:15:181
139618699390,3cyclictest0-21swapper/110:55:121
1396183993928,7cyclictest13550irq/42-30be0000.ethernet10:15:160
1396194993831,5cyclictest1369460-21kworker/u8:2+events_unbound07:37:523
139618699387,28cyclictest1467289-21basename10:35:011
139618699382,3cyclictest1427865-21/usr/sbin/munin08:40:261
139618699381,9cyclictest1442556-21sed09:20:251
139618699381,9cyclictest1412601-21/usr/sbin/munin07:55:111
1396186993816,18cyclictest1457284-21fschecks_time10:05:151
139618699381,4cyclictest1489298-21/usr/sbin/munin11:35:241
139618699381,4cyclictest1458877-21/usr/sbin/munin10:10:151
139618699381,4cyclictest1424555-21/usr/sbin/munin08:30:121
139618699381,3cyclictest1509062-21apt-get12:35:131
139618699381,3cyclictest0-21swapper/112:30:121
139618699381,3cyclictest0-21swapper/109:50:101
139618699381,3cyclictest0-21swapper/109:15:121
139618699381,3cyclictest0-21swapper/108:55:111
139618699381,3cyclictest0-21swapper/108:20:111
139618699381,32cyclictest1403113-21head07:25:251
139618699381,31cyclictest1497068-21fschecks_count12:00:151
139618699381,31cyclictest1444789-21grep09:30:021
139618699381,12cyclictest1448899-21ntp_states09:40:221
139618699381,11cyclictest1503813-21date12:20:011
139618699380,2cyclictest0-21swapper/107:40:111
1396189993730,3cyclictest0-21swapper/212:00:162
1396189993729,5cyclictest1503727-21sendmail12:20:002
1396189993729,4cyclictest0-21swapper/211:40:002
1396189993725,8cyclictest438-21cron10:00:012
139618699371,8cyclictest1473015-21fschecks_count10:50:171
139618699371,3cyclictest629-21snmpd08:28:011
139618699371,3cyclictest1455367-21apt-get10:00:121
139618699371,3cyclictest1454087-21/usr/sbin/munin09:55:191
139618699371,3cyclictest1414342-21diskstats08:00:151
139618699371,3cyclictest0-21swapper/112:25:101
1396194993628,5cyclictest0-21swapper/311:20:003
1396194993627,6cyclictest1501314-21grep12:10:253
1396194993627,6cyclictest0-21swapper/311:00:013
139618999363,4cyclictest131rcu_preempt08:55:122
1396189993628,5cyclictest0-21swapper/209:40:002
139618999361,5cyclictest131rcu_preempt09:40:132
139618699362,30cyclictest1460471-21/usr/sbin/munin10:15:201
139618699361,6cyclictest1478376-21fschecks_time11:05:141
139618699361,3cyclictest629-21snmpd09:13:111
139618699361,3cyclictest629-21snmpd09:13:111
139618699361,3cyclictest0-21swapper/107:30:111
139618699360,3cyclictest0-21swapper/111:00:111
1396183993625,6cyclictest0-21swapper/012:23:440
1396194993528,4cyclictest0-21swapper/308:35:013
1396194993527,4cyclictest0-21swapper/310:25:233
1396194993527,4cyclictest0-21swapper/307:45:253
1396194993523,9cyclictest391ktimers/310:45:123
1396194993523,9cyclictest391ktimers/310:45:113
1396189993524,7cyclictest0-21swapper/208:10:262
1396183993528,3cyclictest0-21swapper/011:39:590
1396194993428,4cyclictest1470371-21kworker/u8:3+events_unbound10:53:333
1396194993427,5cyclictest1406665-21kworker/u8:1+events_unbound08:29:413
1396194993427,5cyclictest1406665-21kworker/u8:1+events_unbound07:57:563
1396194993426,6cyclictest1488382-21kworker/u8:0+events_unbound11:38:393
1396194993426,6cyclictest1433416-21kworker/u8:2+events_unbound09:03:073
1396194993426,4cyclictest0-21swapper/308:50:163
139619499341,5cyclictest131rcu_preempt12:25:113
1396189993423,8cyclictest1499693-21grep12:05:242
1396183993427,4cyclictest1419106-21munin-plugin-st08:15:000
1396183993426,4cyclictest0-21swapper/009:15:250
1396194993326,4cyclictest0-21swapper/308:10:253
1396189993326,3cyclictest0-21swapper/210:00:252
1396189993326,3cyclictest0-21swapper/209:00:252
1396189993326,3cyclictest0-21swapper/208:55:002
1396189993325,5cyclictest0-21swapper/210:39:592
1396189993325,4cyclictest0-21swapper/208:20:002
1396183993326,5cyclictest1406665-21kworker/u8:1+events_unbound08:22:580
1396183993324,6cyclictest0-21swapper/012:15:010
1396183993324,4cyclictest0-21swapper/007:52:530
1396183993323,7cyclictest0-21swapper/007:10:240
1396194993226,3cyclictest0-21swapper/309:40:013
1396194993224,4cyclictest0-21swapper/307:15:273
1396194993220,9cyclictest1437865-21grep09:10:003
1396183993226,3cyclictest0-21swapper/007:55:240
1396183993224,5cyclictest0-21swapper/007:35:000
1396194993124,5cyclictest1475840-21kworker/u8:1+events_unbound11:04:423
1396194993124,5cyclictest1449436-21kworker/u8:1+events_unbound09:58:163
1396194993120,7cyclictest0-21swapper/307:15:013
1396189993124,5cyclictest1475840-21kworker/u8:1+events_unbound11:23:362
1396183993119,9cyclictest1427166-21grep08:35:230
1396189993024,3cyclictest0-21swapper/207:40:012
1396189993023,4cyclictest0-21swapper/211:00:002
1396189993022,4cyclictest0-21swapper/208:25:252
1396189993021,6cyclictest1458117-21grep10:05:232
1396189993021,6cyclictest1451306-21grep09:45:262
1396189993010,6cyclictest131rcu_preempt11:45:112
1396183993019,7cyclictest0-21swapper/010:55:240
1396183993018,9cyclictest1479624-21cron11:10:000
1396183993012,13cyclictest121ktimers/009:30:110
1396194992917,7cyclictest391ktimers/308:20:113
1396189992921,4cyclictest0-21swapper/212:40:002
139618999290,5cyclictest131rcu_preempt07:15:132
1396183992920,6cyclictest1463817-21latency_hist10:25:000
1396183992920,6cyclictest1410857-21kworker/u8:0+events_unbound08:02:540
1396183992919,7cyclictest1506672-21grep12:25:240
1396194992821,5cyclictest1470371-21kworker/u8:3+events_unbound11:51:413
1396194992820,4cyclictest0-21swapper/308:55:263
139618999289,5cyclictest131rcu_preempt07:55:112
1396189992822,4cyclictest1425720-21kworker/u8:3+events_unbound09:08:082
1396189992818,6cyclictest0-21swapper/209:20:262
1396183992821,3cyclictest0-21swapper/012:35:240
1396183992821,3cyclictest0-21swapper/012:00:240
1396183992817,7cyclictest1471378-21cat10:45:190
1396183992817,7cyclictest1471378-21cat10:45:180
139618399281,25cyclictest0-21swapper/010:10:120
139618399281,24cyclictest1465658-21latency_hist10:30:000
1396194992721,3cyclictest0-21swapper/312:35:243
1396194992720,4cyclictest0-21swapper/308:00:263
1396194992719,5cyclictest0-21swapper/311:10:153
139619499271,8cyclictest0-21swapper/309:40:133
1396194992716,8cyclictest1412078-21basename07:55:013
1396183992719,5cyclictest0-21swapper/011:20:010
1396183992718,5cyclictest1439131-21grep09:10:240
1396183992718,5cyclictest1439131-21grep09:10:240
1396183992713,10cyclictest121ktimers/011:25:100
139619499269,4cyclictest1488382-21kworker/u8:0+events_unbound12:25:013
1396194992620,4cyclictest1465512-21kworker/u8:2+events_unbound10:44:483
1396194992620,4cyclictest1459886-21kworker/u8:3+events_unbound10:12:353
1396194992619,4cyclictest1487699-21tail11:30:253
1396194992618,5cyclictest1493275-21auditctl11:49:593
139618999267,10cyclictest32-21ksoftirqd/208:45:232
1396189992616,8cyclictest1472925-21awk10:50:152
1396189992616,7cyclictest1404775-21grep07:30:262
1396189992615,7cyclictest1425441-21grep08:30:252
139618999261,4cyclictest131rcu_preempt11:40:112
1396183992619,4cyclictest1408189-21unixbench_multi07:40:250
1396183992619,3cyclictest0-21swapper/007:15:180
1396183992618,5cyclictest121ktimers/009:01:140
1396183992616,7cyclictest121ktimers/008:15:140
139619499253,4cyclictest131rcu_preempt07:25:143
1396194992519,4cyclictest1502375-21kworker/u8:2+events_unbound12:34:383
1396194992517,6cyclictest1403354-21kworker/u8:3+events_unbound07:34:453
139618999259,9cyclictest32-21ksoftirqd/210:20:222
139618999255,4cyclictest131rcu_preempt10:35:012
1396189992519,3cyclictest0-21swapper/209:10:142
1396189992519,3cyclictest0-21swapper/209:10:142
1396189992518,5cyclictest1459886-21kworker/u8:3+events_unbound10:26:052
1396189992517,5cyclictest0-21swapper/212:25:002
1396189992517,5cyclictest0-21swapper/209:50:162
1396189992516,6cyclictest0-21swapper/207:40:252
1396183992517,6cyclictest121ktimers/011:50:110
1396183992517,5cyclictest1503711-21auditctl12:20:010
1396183992517,5cyclictest0-21swapper/008:40:250
1396183992517,4cyclictest0-21swapper/009:45:010
1396183992516,6cyclictest1496200-21grep11:55:240
1396183992516,6cyclictest1496200-21grep11:55:240
1396183992516,6cyclictest0-21swapper/010:40:000
139618399251,4cyclictest1446736-21diskstats09:35:160
1396183992512,10cyclictest1401647-21sshd07:22:500
139618399251,13cyclictest1484745-21cron11:25:010
1396183992511,10cyclictest1432348-1kworker/0:2H+mmc_complete10:05:010
1396194992418,4cyclictest1461614-21kworker/u8:1+events_unbound10:23:313
1396194992418,4cyclictest1410857-21kworker/u8:0+events_unbound08:09:413
1396194992418,3cyclictest0-21swapper/310:15:263
1396194992418,3cyclictest0-21swapper/309:20:003
1396194992417,4cyclictest0-21swapper/311:25:253
1396194992417,4cyclictest0-21swapper/311:20:243
1396194992417,4cyclictest0-21swapper/308:15:253
1396194992416,5cyclictest0-21swapper/309:55:023
1396194992410,4cyclictest381rcuc/307:40:133
139618999242,3cyclictest131rcu_preempt08:05:192
1396189992418,4cyclictest1410857-21kworker/u8:0+events_unbound08:35:562
1396189992418,3cyclictest0-21swapper/211:10:182
1396189992418,3cyclictest0-21swapper/207:25:002
1396189992417,5cyclictest1475840-21kworker/u8:1+events_unbound11:02:412
1396189992417,5cyclictest1376202-21kworker/u8:0+events_unbound07:14:382
1396189992417,4cyclictest0-21swapper/209:15:252
139618999241,3cyclictest131rcu_preempt08:40:252
1396189992413,7cyclictest1508425-21grep12:30:252
1396183992418,2cyclictest0-21swapper/009:45:180
1396183992417,4cyclictest0-21swapper/011:00:250
139618399241,5cyclictest1429572-21apt-get08:45:130
1396183992414,7cyclictest1499694-21grep12:05:230
1396183992413,6cyclictest1423533-21sort08:25:240
139618399241,20cyclictest0-21swapper/009:05:120
139618399241,19cyclictest0-21swapper/010:30:250
139618399241,19cyclictest0-21swapper/009:58:260
139618399241,19cyclictest0-21swapper/008:59:350
139618399241,19cyclictest0-21swapper/007:26:500
139619499234,17cyclictest1457815-21mailstats10:05:233
139619499232,10cyclictest40-21ksoftirqd/308:45:253
1396194992317,4cyclictest1475840-21kworker/u8:1+events_unbound11:09:433
1396194992317,4cyclictest1439352-21kworker/u8:1+events_unbound09:20:183
1396194992317,4cyclictest1369460-21kworker/u8:2+events_unbound07:24:573
1396194992317,3cyclictest0-21swapper/312:00:253
1396194992316,5cyclictest1425720-21kworker/u8:3+events_unbound09:10:143
1396194992316,5cyclictest1425720-21kworker/u8:3+events_unbound09:10:133
1396189992316,5cyclictest1406665-21kworker/u8:1+events_unbound08:00:142
1396189992316,4cyclictest1506231-21ntpq12:25:202
1396189992316,3cyclictest0-21swapper/210:15:252
1396189992315,5cyclictest0-21swapper/211:30:002
1396189992315,5cyclictest0-21swapper/207:25:252
1396183992316,4cyclictest1452942-21tail09:50:260
1396183992316,3cyclictest0-21swapper/011:46:190
1396183992316,3cyclictest0-21swapper/008:31:560
1396183992316,3cyclictest0-21swapper/007:35:050
139618399231,20cyclictest0-21swapper/011:43:590
139618399231,20cyclictest0-21swapper/008:05:180
139618399230,21cyclictest0-21swapper/010:44:310
139618399230,19cyclictest0-21swapper/011:10:080
1396194992216,4cyclictest1406665-21kworker/u8:1+events_unbound08:36:413
1396194992216,3cyclictest0-21swapper/310:35:243
1396194992214,6cyclictest1486095-21kworker/u8:2+events_unbound11:43:503
1396194992213,6cyclictest1445545-21wc09:30:213
1396194992211,8cyclictest1495207-21apt-get11:55:113
1396194992211,8cyclictest1495207-21apt-get11:55:113
1396189992214,5cyclictest0-21swapper/210:10:152
139618999221,3cyclictest131rcu_preempt10:40:242
1396183992215,5cyclictest0-21swapper/009:20:260
1396194992115,3cyclictest0-21swapper/308:40:213
1396194992113,5cyclictest391ktimers/309:25:113
139618999218,7cyclictest32-21ksoftirqd/211:05:242
1396183992114,5cyclictest121ktimers/011:30:210
139618399210,17cyclictest0-21swapper/008:52:360
139618399201,15cyclictest0-21swapper/010:54:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional