You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 03:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sun Jun 21, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1351597995041,5cyclictest1407327-21ls21:50:000
1351612994839,5cyclictest1438229-21munin-plugin-st23:20:013
1351612994638,5cyclictest1396883-21cat21:20:003
1351612994432,8cyclictest1426080-21sh22:45:003
1351606994438,4cyclictest1355731-21munin-plugin-st19:20:002
1351606994437,4cyclictest1362538-21cron19:40:002
1351606994437,4cyclictest1362538-21cron19:40:002
1351606994434,6cyclictest1394539-21grep21:10:252
1351606994434,6cyclictest1394539-21grep21:10:252
1351603994436,4cyclictest1417938-21fschecks_count22:20:161
1351603994432,8cyclictest1393254-21cron21:10:001
1351603994432,8cyclictest1393254-21cron21:10:001
1351612994335,5cyclictest1383416-21cut20:40:153
1351612994232,6cyclictest1408588-21grep21:50:263
1351612994132,5cyclictest1410244-21unixbench_multi21:55:253
1351612994132,5cyclictest1410244-21unixbench_multi21:55:253
1351603994130,6cyclictest0-21swapper/120:45:001
1351597994134,4cyclictest1417561-21sendmail22:20:010
1351597994130,8cyclictest1383014-21munin-plugin-st20:40:000
1351597994126,12cyclictest121ktimers/023:45:110
1351597994034,4cyclictest1465726-21grep00:40:010
1351597994027,8cyclictest1367184-21tail19:50:260
1351603993932,4cyclictest1355749-21sendmail19:20:011
1351597993927,8cyclictest1405215-21grep21:40:260
135161299389,10cyclictest1441098-21ls23:25:263
1351612993829,5cyclictest1365961-21sh19:50:003
1351612993829,5cyclictest0-21swapper/321:45:003
1351603993831,5cyclictest1348023-21kworker/u8:1+events_unbound20:12:121
1351612993727,7cyclictest391ktimers/300:30:113
1351612993724,9cyclictest391ktimers/323:30:113
1351606993727,6cyclictest0-21swapper/223:25:162
1351606993727,6cyclictest0-21swapper/223:05:002
1351606993727,6cyclictest0-21swapper/222:55:262
1351606993726,8cyclictest1391548-21auditctl21:05:002
1351606993726,7cyclictest1384721-21sh20:45:002
1351606993722,12cyclictest311ktimers/219:20:122
1351603993627,6cyclictest1465254-21grep00:35:241
1351603993624,9cyclictest231ktimers/120:05:121
1351612993527,4cyclictest0-21swapper/320:30:143
1351606993526,6cyclictest0-21swapper/200:25:002
1351606993525,6cyclictest0-21swapper/220:55:002
1351603993527,4cyclictest0-21swapper/100:30:321
1351603993526,5cyclictest1417082-21unixbench_multi22:15:241
1351603993525,7cyclictest1403898-21sh21:40:001
1351603993519,5cyclictest131rcu_preempt21:25:131
1351597993527,4cyclictest0-21swapper/023:30:000
1351612993427,4cyclictest1462321-21sh00:30:003
1351612993419,12cyclictest1433440-21/usr/sbin/munin23:05:133
1351612993418,10cyclictest0-21swapper/323:35:103
1351606993426,5cyclictest0-21swapper/221:30:262
1351606993426,5cyclictest0-21swapper/221:30:262
1351606993426,4cyclictest0-21swapper/221:52:372
1351606993424,7cyclictest1364259-21sh19:45:002
1351603993426,4cyclictest0-21swapper/121:42:321
1351603993423,7cyclictest1441171-21grep23:25:251
1351612993325,5cyclictest1433130-21munin-plugin-st23:05:003
1351612993324,5cyclictest1392802-21unixbench_multi21:05:243
1351612993324,5cyclictest1392802-21unixbench_multi21:05:243
1351612993322,8cyclictest1402110-21cron21:34:003
1351612993322,8cyclictest1402110-21cron21:34:003
1351606993325,4cyclictest0-21swapper/220:25:262
1351606993324,5cyclictest0-21swapper/219:45:262
1351606993324,4cyclictest0-21swapper/220:35:152
1351606993322,7cyclictest1389859-21sendmail-msp21:00:002
1351603993325,4cyclictest1386429-21apt20:50:001
1351597993326,3cyclictest0-21swapper/022:40:000
1351597993322,7cyclictest1392832-21grep21:05:240
1351597993322,7cyclictest1392832-21grep21:05:240
1351612993226,4cyclictest1465271-21unixbench_multi00:35:243
1351612993224,4cyclictest0-21swapper/319:25:163
1351612993222,6cyclictest0-21swapper/322:15:243
1351612993221,7cyclictest1385949-21grep20:45:263
1351612993219,8cyclictest1453185-21grep00:00:263
1351606993226,3cyclictest1396896-21sendmail21:20:002
1351606993224,4cyclictest0-21swapper/222:20:262
1351606993223,5cyclictest0-21swapper/223:20:232
1351606993223,5cyclictest0-21swapper/222:00:162
1351603993226,4cyclictest1405415-21kworker/u8:2+events_unbound22:42:481
1351603993224,4cyclictest0-21swapper/123:55:241
1351603993224,4cyclictest0-21swapper/121:00:251
1351603993224,4cyclictest0-21swapper/119:55:171
1351597993226,3cyclictest645-21runrttasks00:25:120
1351597993223,7cyclictest1359909-21ntp_kernel_pll_19:30:200
1351597993223,7cyclictest1359909-21ntp_kernel_pll_19:30:200
1351597993222,6cyclictest1456773-21unixbench_singl00:10:270
1351612993124,4cyclictest1403907-21cron21:40:003
1351612993123,4cyclictest0-21swapper/322:25:153
1351612993122,6cyclictest1424363-21sh22:40:003
1351612993118,10cyclictest1451058-21/usr/sbin/munin23:55:213
1351612993116,12cyclictest1370190-21sh20:00:223
1351606993123,4cyclictest0-21swapper/223:35:242
1351606993123,3cyclictest0-21swapper/200:10:272
1351606993122,6cyclictest0-21swapper/223:35:002
1351603993121,7cyclictest0-21swapper/122:00:011
1351603993121,7cyclictest0-21swapper/122:00:011
1351612993019,8cyclictest1430058-21/usr/sbin/munin22:55:163
1351612993010,14cyclictest1378051-21latency_hist20:25:013
1351606993023,3cyclictest0-21swapper/223:05:252
1351606993023,3cyclictest0-21swapper/200:25:252
1351606993022,4cyclictest0-21swapper/221:55:262
1351606993022,4cyclictest0-21swapper/221:55:262
1351606993021,5cyclictest0-21swapper/221:35:262
1351606993021,4cyclictest0-21swapper/221:25:002
1351603993023,4cyclictest0-21swapper/119:35:261
1351603993023,4cyclictest0-21swapper/119:35:261
1351603993021,4cyclictest131rcu_preempt00:10:231
1351603993020,6cyclictest1370683-21head20:00:251
135159799308,18cyclictest0-21swapper/023:50:260
1351597993022,4cyclictest0-21swapper/022:05:010
1351597993021,6cyclictest1417981-21fschecks_time22:20:160
1351612992921,5cyclictest1362547-21kthreadd19:40:003
1351612992921,5cyclictest1362547-21kthreadd19:40:003
1351612992920,5cyclictest0-21swapper/320:10:253
1351612992919,7cyclictest1445292-21/usr/sbin/munin23:40:253
1351612992919,7cyclictest1399489-21/usr/sbin/munin21:25:213
1351612992919,7cyclictest1393488-21apt-get21:10:133
1351612992919,7cyclictest1393488-21apt-get21:10:133
1351612992917,9cyclictest1378192-21/usr/sbin/munin20:25:143
1351612992917,7cyclictest0-21swapper/300:05:253
1351612992916,11cyclictest1447334-21kernelversion23:45:173
1351612992915,11cyclictest1460275-21cron00:21:003
1351612992914,12cyclictest1356727-21/usr/sbin/munin19:20:253
1351612992913,10cyclictest0-21swapper/320:05:123
1351606992923,4cyclictest1359374-21/usr/sbin/munin19:30:162
1351606992923,4cyclictest1359374-21/usr/sbin/munin19:30:162
1351606992921,4cyclictest0-21swapper/222:45:252
1351606992921,4cyclictest0-21swapper/222:45:252
1351603992922,5cyclictest412158-21kworker/u8:0+events_unbound19:32:071
1351603992922,5cyclictest412158-21kworker/u8:0+events_unbound19:32:061
1351603992922,4cyclictest1414138-21cron22:10:001
1351603992919,7cyclictest1388122-21sh20:55:011
1351603992918,7cyclictest1-21systemd00:22:591
1351597992923,4cyclictest1348023-21kworker/u8:1+events_unbound19:17:070
1351597992919,6cyclictest1389419-21grep20:55:250
1351597992919,6cyclictest0-21swapper/020:35:000
1351612992822,3cyclictest1397454-21diskstats21:20:173
1351612992821,4cyclictest1412679-21apt-get22:05:133
1351612992818,7cyclictest1455728-21/usr/sbin/munin00:10:123
1351612992818,7cyclictest1390595-21/usr/sbin/munin21:00:213
1351612992818,7cyclictest1359682-21/usr/sbin/munin19:30:173
1351612992818,7cyclictest1359682-21/usr/sbin/munin19:30:173
1351612992817,8cyclictest1407151-21cron21:48:013
1351612992817,8cyclictest1362794-21apt-get19:40:113
1351612992817,8cyclictest1354703-21/usr/sbin/munin19:15:193
1351612992816,9cyclictest1374975-21/usr/sbin/munin20:15:173
1351612992816,9cyclictest1368336-21/usr/sbin/munin19:55:203
1351612992815,10cyclictest1415582-21cron22:12:013
1351606992821,3cyclictest0-21swapper/200:05:252
1351606992820,5cyclictest0-21swapper/222:35:002
1351606992817,8cyclictest1426201-21apt-config22:45:012
135160399289,4cyclictest131rcu_preempt23:50:121
1351603992820,4cyclictest0-21swapper/100:05:161
1351603992818,7cyclictest231ktimers/122:10:141
1351603992818,7cyclictest1363844-21grep19:40:231
1351597992819,5cyclictest0-21swapper/023:45:000
1351597992818,6cyclictest0-21swapper/019:42:060
135159799281,25cyclictest0-21swapper/021:20:290
1351612992718,6cyclictest1386896-21/usr/sbin/munin20:50:163
1351612992718,5cyclictest0-21swapper/322:20:253
1351612992717,7cyclictest1427823-21cron22:48:003
1351612992717,7cyclictest1427823-21cron22:48:003
1351612992717,7cyclictest0-21swapper/321:00:003
1351612992714,10cyclictest1449635-21/usr/sbin/munin23:50:263
1351612992713,11cyclictest1352221-21/usr/sbin/munin19:10:173
1351612992713,10cyclictest1422415-21taskset22:32:073
1351606992721,4cyclictest1436480-21kworker/u8:1+events_unbound00:02:592
1351606992719,4cyclictest0-21swapper/223:55:242
1351606992717,7cyclictest1366355-21fschecks_count19:50:162
1351603992719,6cyclictest1384402-21kworker/u8:0+events_unbound21:10:181
1351603992719,6cyclictest1384402-21kworker/u8:0+events_unbound21:10:171
1351603992715,8cyclictest204-21dbus-daemon20:17:131
1351597992721,3cyclictest0-21swapper/021:35:260
1351597992720,4cyclictest1438227-21cron23:20:000
135161299269,13cyclictest1438676-21grep23:20:153
1351612992620,3cyclictest1428229-21apt-get22:50:123
1351612992619,3cyclictest1411423-21meminfo22:00:193
1351612992616,7cyclictest1381648-21/usr/sbin/munin20:35:153
1351612992611,11cyclictest1367661-21sh19:55:013
1351612992610,13cyclictest1435523-21sed23:10:183
1351606992620,4cyclictest1351590-21cyclictest21:05:182
1351606992620,4cyclictest1351590-21cyclictest21:05:172
1351606992620,3cyclictest0-21swapper/219:30:002
1351606992619,3cyclictest0-21swapper/200:35:152
1351606992618,5cyclictest0-21swapper/219:15:012
1351606992617,6cyclictest0-21swapper/222:20:012
1351606992613,9cyclictest1-21systemd23:52:572
1351603992619,5cyclictest1391391-21kworker/u8:1+events_unbound21:23:131
1351603992619,5cyclictest1367485-21kworker/u8:3+events_unbound19:54:421
1351603992619,4cyclictest0-21swapper/122:30:261
1351603992618,4cyclictest0-21swapper/123:30:141
1351603992616,7cyclictest1376668-21grep20:20:161
1351603992614,8cyclictest1445059-21tr23:40:001
135159799266,4cyclictest1394245-21expr21:10:240
135159799266,4cyclictest1394245-21expr21:10:240
1351597992619,3cyclictest0-21swapper/021:15:240
1351597992615,8cyclictest1351590-21cyclictest19:20:120
1351597992615,7cyclictest204-21dbus-daemon20:22:130
1351612992516,6cyclictest1457539-21df_inode00:15:153
1351612992516,6cyclictest1457539-21df_inode00:15:143
1351606992517,4cyclictest0-21swapper/222:40:002
1351606992516,5cyclictest0-21swapper/223:15:012
1351606992516,5cyclictest0-21swapper/220:25:012
1351603992519,4cyclictest1384402-21kworker/u8:0+events_unbound22:27:451
1351603992518,4cyclictest0-21swapper/122:45:261
1351603992518,4cyclictest0-21swapper/122:45:251
1351603992517,5cyclictest438-21cron21:50:001
1351603992517,4cyclictest0-21swapper/122:55:171
1351603992517,4cyclictest0-21swapper/122:55:001
1351603992517,4cyclictest0-21swapper/120:35:251
1351603992516,4cyclictest0-21swapper/119:47:071
135159799251,9cyclictest204-21dbus-daemon22:32:450
1351597992519,4cyclictest1370648-21grep20:00:250
1351597992518,4cyclictest1407768-21fschecks_time21:50:170
1351597992518,3cyclictest0-21swapper/022:25:220
1351597992518,3cyclictest0-21swapper/022:10:170
135159799251,20cyclictest0-21swapper/023:09:040
135159799251,19cyclictest1445214-21sed23:40:010
1351606992418,3cyclictest0-21swapper/221:45:262
1351606992417,4cyclictest0-21swapper/223:20:012
1351606992417,4cyclictest0-21swapper/221:25:192
1351606992417,3cyclictest0-21swapper/222:50:252
1351606992416,5cyclictest0-21swapper/223:45:242
135160699241,12cyclictest0-21swapper/220:00:152
1351603992418,3cyclictest0-21swapper/120:55:191
1351603992418,3cyclictest0-21swapper/100:25:131
1351603992417,4cyclictest1359149-21latency_hist19:30:001
1351603992417,3cyclictest0-21swapper/100:20:001
1351603992417,3cyclictest0-21swapper/100:20:001
1351597992418,2cyclictest0-21swapper/020:05:160
1351597992417,4cyclictest0-21swapper/022:45:150
1351597992417,4cyclictest0-21swapper/022:45:150
1351597992414,6cyclictest0-21swapper/020:50:250
1351597992414,6cyclictest0-21swapper/019:25:160
135159799241,19cyclictest0-21swapper/023:21:470
135159799241,19cyclictest0-21swapper/020:26:260
135159799241,19cyclictest0-21swapper/000:02:100
135159799241,10cyclictest1352054-21df19:10:140
1351597992410,10cyclictest121ktimers/021:30:130
1351597992410,10cyclictest121ktimers/021:30:130
1351606992316,4cyclictest1445843-21ntpq23:40:202
1351606992315,5cyclictest0-21swapper/219:55:162
1351606992312,8cyclictest1373124-21df_inode20:10:142
135160399232,3cyclictest131rcu_preempt22:35:251
1351603992316,5cyclictest1395390-21kworker/u8:4+events_unbound21:18:341
1351603992315,4cyclictest1439514-21grep23:20:241
1351603992315,4cyclictest0-21swapper/120:30:011
1351603992315,4cyclictest0-21swapper/100:00:261
135160399231,3cyclictest0-21swapper/121:50:181
1351603992313,6cyclictest0-21swapper/120:30:131
135159799234,3cyclictest13856532grep20:45:240
1351597992318,3cyclictest1365432-21timerwakeupswit19:45:240
1351597992317,3cyclictest13550irq/42-30be0000.ethernet21:00:240
1351597992317,3cyclictest0-21swapper/000:05:160
1351597992317,2cyclictest0-21swapper/019:55:220
1351597992316,3cyclictest0-21swapper/023:14:460
1351597992316,3cyclictest0-21swapper/022:57:400
1351597992315,4cyclictest0-21swapper/022:55:000
1351597992314,5cyclictest0-21swapper/023:55:150
135159799231,19cyclictest1361707-21ps19:35:230
135159799231,19cyclictest1361707-21ps19:35:230
135159799231,18cyclictest0-21swapper/021:25:490
135160699227,5cyclictest412158-21kworker/u8:0+events_unbound20:10:012
135160699226,9cyclictest131rcu_preempt22:05:232
1351603992215,5cyclictest412158-21kworker/u8:0+events_unbound19:13:331
1351603992211,7cyclictest1436530-21munin-run23:15:011
1351603992210,8cyclictest1438232-21cut23:20:011
135160399220,14cyclictest0-21swapper/119:22:141
135159799221,6cyclictest131rcu_preempt22:40:110
1351597992216,3cyclictest13550irq/42-30be0000.ethernet23:30:180
1351597992214,5cyclictest0-21swapper/000:20:170
1351597992212,8cyclictest1410214-21sed21:55:250
1351597992212,8cyclictest1410214-21sed21:55:250
135159799221,19cyclictest0-21swapper/023:00:540
135159799221,19cyclictest0-21swapper/000:33:250
135159799221,11cyclictest645-21runrttasks00:17:500
135159799221,11cyclictest645-21runrttasks00:17:500
135159799220,20cyclictest0-21swapper/020:10:350
135159799220,18cyclictest0-21swapper/022:05:090
135159799220,18cyclictest0-21swapper/020:40:070
135159799220,18cyclictest0-21swapper/020:19:040
1351606992115,3cyclictest0-21swapper/222:25:192
1351606992113,4cyclictest0-21swapper/200:30:252
1351603992115,4cyclictest1434825-21munin-run23:10:011
1351603992114,4cyclictest1402195-21cron21:35:011
1351603992114,4cyclictest1402195-21cron21:35:001
135160399211,11cyclictest0-21swapper/123:47:571
1351606992014,3cyclictest0-21swapper/220:30:152
135160399195,10cyclictest1446581-21sshd23:42:561
1351603991912,5cyclictest231ktimers/122:00:211
1351603991911,5cyclictest0-21swapper/123:00:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional