You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 12:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Thu Jul 02, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1288242995646,6cyclictest204-21dbus-daemon20:05:233
1288231994939,6cyclictest1391544-21grep00:05:290
1288231994932,13cyclictest121ktimers/000:35:100
1288242994838,6cyclictest1354028-21sendmail22:20:013
1288242994740,4cyclictest1316272-21auditctl20:30:003
1288235994437,5cyclictest1393299-21kworker/u8:3+events_unbound00:28:431
128823199437,14cyclictest1378141-21latency_hist23:30:000
1288242994236,4cyclictest1345167-21kworker/u8:0+events_unbound22:00:473
1288238994234,5cyclictest1400515-21idleruntime-cro00:35:002
1288238994234,5cyclictest1400515-21idleruntime-cro00:34:592
1288235994233,4cyclictest0-21swapper/119:25:171
128823199426,9cyclictest1393108-21expr00:10:250
1288231994230,8cyclictest1300484-21grep19:40:250
1288242994132,5cyclictest1360830-21sendmail22:40:003
128823199411,22cyclictest1346651-21sed21:55:250
1288242994033,5cyclictest1314291-21kworker/u8:1+events_unbound21:15:393
1288242994033,5cyclictest1314291-21kworker/u8:1+events_unbound21:15:393
128824299403,13cyclictest40-21ksoftirqd/320:30:103
1288242994029,7cyclictest1306044-21sendmail20:00:013
1288238994032,4cyclictest0-21swapper/200:13:412
1288235994033,4cyclictest1381513-21munin-plugin-st23:39:591
1288235994031,5cyclictest1300927-21cron19:45:011
1288231994011,12cyclictest1383460-21apt-get23:45:100
1288242993933,4cyclictest1350359-21kworker/u8:0+events_unbound22:10:493
1288242993932,5cyclictest1362357-21kworker/u8:0+events_unbound22:45:573
1288238993929,6cyclictest1290058-21taskset19:15:022
1288235993931,4cyclictest1374687-21munin-run23:20:001
128823199399,10cyclictest1292602-21grep19:20:150
128823199398,14cyclictest1334294-21missed_timers21:20:190
1288242993832,4cyclictest1393299-21kworker/u8:3+events_unbound00:38:463
1288238993829,6cyclictest1372561-21unixbench_singl23:10:252
1288238993827,7cyclictest1333343-21idleruntime-cro21:20:012
1288238993827,7cyclictest1333343-21idleruntime-cro21:20:002
1288235993830,4cyclictest0-21swapper/122:20:001
128823199388,11cyclictest1319674-21latency_hist20:40:020
128823199386,13cyclictest1400011-21timerwakeupswit00:30:260
128823199386,13cyclictest1400011-21timerwakeupswit00:30:250
128823199384,18cyclictest0-21swapper/020:00:000
1288242993730,4cyclictest0-21swapper/323:50:003
1288238993730,5cyclictest1292006-21kworker/u8:0+events_unbound19:35:192
1288238993726,6cyclictest0-21swapper/221:50:262
128823199378,12cyclictest1326131-21chrt20:55:370
1288231993729,4cyclictest1292163-21cron19:20:000
1288231993726,8cyclictest1379378-21grep23:30:250
1288231993726,8cyclictest1379378-21grep23:30:250
1288242993615,13cyclictest131rcu_preempt22:20:123
1288242993614,13cyclictest40-21ksoftirqd/321:00:253
1288235993627,4cyclictest0-21swapper/119:25:011
1288235993626,7cyclictest1345849-21fschecks_count21:55:151
1288235993625,7cyclictest1386621-21sh23:55:011
128823199369,10cyclictest1381973-21fschecks_time23:40:140
1288231993625,7cyclictest1295383-21grep19:25:260
1288242993527,4cyclictest0-21swapper/323:00:283
1288242993527,4cyclictest0-21swapper/319:50:163
1288242993516,6cyclictest131rcu_preempt23:15:233
1288242993515,12cyclictest40-21ksoftirqd/320:40:263
1288238993527,4cyclictest0-21swapper/220:05:242
1288235993523,7cyclictest1317971-21auditctl20:35:011
128823199359,10cyclictest1368463-21ntp_states23:00:240
1288231993527,4cyclictest0-21swapper/020:00:250
1288231993527,4cyclictest0-21swapper/020:00:250
1288242993412,7cyclictest1367329-21kworker/u8:0+events_freezable_power_23:31:433
1288242993412,7cyclictest1367329-21kworker/u8:0+events_freezable_power_23:31:423
1288238993427,3cyclictest0-21swapper/222:00:152
1288235993426,4cyclictest0-21swapper/119:55:231
1288231993424,7cyclictest1371286-21idleruntime-cro23:10:010
1288242993327,4cyclictest1381125-21kworker/u8:1+events_unbound23:41:073
1288242993326,4cyclictest1289854-21cron19:15:003
1288242993326,4cyclictest0-21swapper/322:55:243
1288242993325,5cyclictest204-21dbus-daemon19:30:193
1288242993325,4cyclictest0-21swapper/300:05:303
1288242993324,6cyclictest1292173-21sendmail19:20:003
1288242993322,3cyclictest131rcu_preempt19:40:243
1288242993320,5cyclictest1314291-21kworker/u8:1+events_unbound20:46:323
1288242993313,12cyclictest40-21ksoftirqd/320:10:263
1288238993320,10cyclictest311ktimers/221:25:122
1288231993325,5cyclictest1372561-21unixbench_singl23:10:240
1288231993322,7cyclictest1386625-21auditctl23:55:000
1288231993310,5cyclictest11-21ksoftirqd/023:35:240
1288242993225,4cyclictest438-21cron21:50:003
128824299321,8cyclictest0-21swapper/320:20:113
128824299321,5cyclictest0-21swapper/320:00:133
128824299321,5cyclictest0-21swapper/320:00:133
1288242993213,12cyclictest131rcu_preempt22:50:213
1288242993211,12cyclictest40-21ksoftirqd/321:25:273
1288242993210,13cyclictest40-21ksoftirqd/300:15:143
1288238993225,4cyclictest0-21swapper/223:05:262
1288238993225,4cyclictest0-21swapper/219:50:242
1288238993224,5cyclictest0-21swapper/200:10:012
1288238993224,3cyclictest0-21swapper/223:20:272
1288235993224,4cyclictest0-21swapper/123:55:261
1288242993123,4cyclictest0-21swapper/323:20:263
1288242993123,4cyclictest0-21swapper/320:55:253
1288242993121,4cyclictest1357354-21kworker/u8:1+events_unbound22:42:423
1288242993117,5cyclictest1345167-21kworker/u8:0+events_unbound21:52:573
1288238993122,6cyclictest0-21swapper/219:20:002
1288235993121,6cyclictest0-21swapper/123:05:011
128823599311,4cyclictest131rcu_preempt20:40:121
128823199318,6cyclictest0-21swapper/021:50:230
128823199314,10cyclictest1358764-21chrt22:30:480
128823199314,10cyclictest1358764-21chrt22:30:470
128823199313,11cyclictest1324024-21mailstats20:50:230
128824299308,12cyclictest40-21ksoftirqd/323:05:253
1288242993022,4cyclictest0-21swapper/300:35:003
1288242993022,4cyclictest0-21swapper/300:35:003
1288242993020,3cyclictest131rcu_preempt23:50:233
1288242993019,8cyclictest381rcuc/322:25:123
1288242993019,8cyclictest381rcuc/322:25:123
1288242993012,5cyclictest40-21ksoftirqd/320:40:003
1288242993012,11cyclictest0-21swapper/319:27:553
1288242993010,13cyclictest40-21ksoftirqd/321:05:153
1288235993021,4cyclictest0-21swapper/120:05:241
1288235993019,7cyclictest0-21swapper/100:35:251
1288235993018,8cyclictest0-21swapper/122:00:241
128823199309,5cyclictest1386623-21apt-get23:55:030
1288231993022,5cyclictest1360356-21grep22:35:250
1288231993019,7cyclictest1338204-21grep21:30:270
1288231993017,10cyclictest1322376-21/usr/sbin/munin20:45:250
1288231993011,6cyclictest1338892-21/usr/sbin/munin21:35:160
1288242992923,4cyclictest1333314-21kworker/u8:2+events_unbound21:20:403
1288242992922,3cyclictest0-21swapper/319:40:003
1288242992921,6cyclictest1345167-21kworker/u8:0+events_unbound21:55:473
1288242992918,8cyclictest391ktimers/321:40:113
1288242992912,3cyclictest131rcu_preempt00:25:263
1288238992923,3cyclictest0-21swapper/220:40:002
1288238992922,4cyclictest438-21cron21:15:012
1288238992922,4cyclictest438-21cron21:15:002
1288238992922,3cyclictest0-21swapper/200:00:152
1288235992921,5cyclictest0-21swapper/120:10:251
1288235992921,4cyclictest0-21swapper/121:15:171
1288235992921,4cyclictest0-21swapper/121:15:161
1288235992921,4cyclictest0-21swapper/100:00:241
1288235992919,6cyclictest0-21swapper/122:35:241
1288235992916,7cyclictest1369072-21kworker/u8:2+events_unbound23:08:001
128823599291,5cyclictest131rcu_preempt22:40:121
128823199298,18cyclictest0-21swapper/021:45:200
1288231992919,7cyclictest1321388-21sh20:45:010
1288231992916,10cyclictest1301268-21/usr/sbin/munin19:45:150
128824299286,5cyclictest131rcu_preempt23:30:003
128824299285,3cyclictest131rcu_preempt00:14:593
1288242992822,4cyclictest1346883-21kworker/u8:1+events_unbound22:07:063
1288242992818,6cyclictest0-21swapper/321:40:003
1288242992815,5cyclictest131rcu_preempt23:35:263
1288242992812,6cyclictest40-21ksoftirqd/320:15:273
1288242992812,5cyclictest131rcu_preempt21:35:013
1288238992822,4cyclictest0-21swapper/222:05:242
1288238992821,3cyclictest0-21swapper/222:30:242
1288238992821,3cyclictest0-21swapper/222:30:242
1288238992820,4cyclictest0-21swapper/223:35:262
1288238992820,4cyclictest0-21swapper/223:25:232
1288238992820,4cyclictest0-21swapper/222:25:262
1288238992820,4cyclictest0-21swapper/222:25:262
1288238992820,4cyclictest0-21swapper/220:25:252
1288235992817,7cyclictest1-21systemd00:33:431
1288235992817,7cyclictest1-21systemd00:33:431
1288235992816,7cyclictest0-21swapper/122:05:251
128823599281,4cyclictest131rcu_preempt21:35:131
128823599281,4cyclictest131rcu_preempt20:45:131
128823599281,4cyclictest131rcu_preempt20:25:141
128823199289,6cyclictest645-21runrttasks20:15:190
128823199289,15cyclictest1296487-21sshd19:30:180
128823199287,7cyclictest1333540-21latency_hist21:20:000
128823199287,7cyclictest1333540-21latency_hist21:20:000
128823199285,20cyclictest1330022-21wc21:10:010
1288231992820,5cyclictest0-21swapper/020:20:230
1288231992820,5cyclictest0-21swapper/020:05:250
1288231992818,7cyclictest1348726-21cron22:03:000
1288231992818,5cyclictest0-21swapper/022:55:000
1288231992816,10cyclictest1355959-21apt-get22:25:110
1288231992816,10cyclictest1355959-21apt-get22:25:110
1288231992815,10cyclictest1367489-21sshd22:58:100
1288231992814,11cyclictest0-21swapper/021:00:130
128824299278,5cyclictest131rcu_preempt23:55:033
128824299278,5cyclictest131rcu_preempt19:25:023
128824299277,11cyclictest40-21ksoftirqd/300:20:263
128824299276,11cyclictest40-21ksoftirqd/321:10:183
128824299276,11cyclictest40-21ksoftirqd/321:10:183
1288242992713,6cyclictest131rcu_preempt19:45:263
1288242992710,10cyclictest40-21ksoftirqd/323:15:023
1288238992720,4cyclictest0-21swapper/221:30:272
1288238992718,6cyclictest1340352-21cron21:40:012
1288238992716,7cyclictest0-21swapper/223:55:012
1288235992720,5cyclictest1302284-21kworker/u8:1+events_unbound19:50:231
1288235992720,4cyclictest0-21swapper/122:55:251
1288235992719,5cyclictest1292006-21kworker/u8:0+events_unbound19:30:181
1288235992719,4cyclictest0-21swapper/121:00:261
1288235992719,4cyclictest0-21swapper/120:55:161
1288235992718,5cyclictest1376400-21sh23:25:011
1288235992716,7cyclictest1393667-21debian-sa100:14:591
1288235992716,7cyclictest0-21swapper/123:25:241
128823599271,4cyclictest131rcu_preempt21:50:121
1288231992717,7cyclictest1396399-21/usr/sbin/munin00:20:260
1288231992717,7cyclictest1330526-21/usr/sbin/munin21:10:180
1288231992717,7cyclictest1330526-21/usr/sbin/munin21:10:170
1288231992716,8cyclictest1317650-21sshd20:31:090
1288231992712,12cyclictest1290033-21latency_hist19:15:010
1288231992711,13cyclictest1388951-21fschecks_count00:00:150
1288231992710,14cyclictest1315304-21sed20:25:200
1288231992710,14cyclictest1302848-21taskset19:50:080
1288242992616,6cyclictest0-21swapper/320:55:013
1288238992620,4cyclictest1395066-21kworker/u8:0+events_unbound00:18:432
1288238992618,5cyclictest0-21swapper/220:00:012
1288238992618,4cyclictest0-21swapper/219:45:162
1288238992617,6cyclictest1367329-21kworker/u8:0-ext4-rsv-conversion23:00:012
1288238992617,5cyclictest0-21swapper/221:00:012
1288238992615,7cyclictest0-21swapper/220:40:252
128823599264,6cyclictest131rcu_preempt22:50:131
1288235992620,4cyclictest1311835-21kworker/u8:0+events_unbound20:20:281
1288235992620,3cyclictest0-21swapper/123:10:211
1288235992620,3cyclictest0-21swapper/119:35:191
1288235992619,5cyclictest1314291-21kworker/u8:1+events_unbound21:05:251
1288235992616,6cyclictest0-21swapper/122:45:251
1288235992615,7cyclictest1-21systemd22:30:531
1288235992615,7cyclictest1-21systemd22:30:531
1288235992615,7cyclictest0-21swapper/100:25:001
128823199265,18cyclictest0-21swapper/023:20:210
1288231992616,8cyclictest1374910-21cat23:20:010
1288231992616,7cyclictest1355683-21chrt22:24:370
1288231992615,8cyclictest0-21swapper/000:25:120
1288231992615,7cyclictest204-21dbus-daemon20:10:260
1288231992611,12cyclictest1351464-21/usr/sbin/munin22:10:220
128824299251,12cyclictest0-21swapper/300:00:203
1288238992518,4cyclictest0-21swapper/220:20:012
1288235992520,3cyclictest1395582-21latency_hist00:20:011
1288235992519,4cyclictest1389937-21kworker/u8:0+events_unbound00:06:411
1288235992519,3cyclictest0-21swapper/120:35:221
128823599251,8cyclictest645-21runrttasks21:10:241
128823599251,8cyclictest645-21runrttasks21:10:241
1288235992515,7cyclictest1289981-21cat19:15:021
1288235992514,8cyclictest1357521-21date22:30:011
1288235992514,8cyclictest1357521-21date22:30:001
128823599251,3cyclictest131rcu_preempt23:45:121
128823599251,12cyclictest0-21swapper/121:20:401
128823199258,12cyclictest1354202-21wc22:20:010
1288231992515,7cyclictest1361132-21/usr/sbin/munin22:40:140
1288231992515,7cyclictest1341361-21sensors_temp21:40:230
1288231992514,8cyclictest1362897-21diskstats22:45:140
1288231992512,9cyclictest1395366-21cron00:19:590
1288231992511,11cyclictest1349344-21/usr/sbin/munin22:05:150
128823899247,3cyclictest131rcu_preempt00:25:262
1288238992417,3cyclictest0-21swapper/219:40:162
1288238992417,3cyclictest0-21swapper/200:20:252
1288238992415,6cyclictest1402222-21ls00:40:002
1288238992415,6cyclictest1351820-21unixbench_multi22:10:242
1288238992415,4cyclictest1293881-21cron19:25:002
1288235992418,4cyclictest1314291-21kworker/u8:1+events_unbound21:30:411
1288235992417,5cyclictest1311835-21kworker/u8:0+events_unbound20:17:061
1288235992416,4cyclictest0-21swapper/122:10:241
1288235992415,4cyclictest0-21swapper/121:45:261
1288235992413,6cyclictest0-21swapper/119:15:281
1288238992317,3cyclictest0-21swapper/221:10:002
1288238992316,5cyclictest1333314-21kworker/u8:2+events_unbound21:24:412
1288238992316,4cyclictest0-21swapper/220:10:252
1288238992315,4cyclictest0-21swapper/223:40:152
1288238992315,4cyclictest0-21swapper/222:35:532
1288238992314,6cyclictest1374196-21unixbench_multi23:15:242
1288238992311,9cyclictest1379082-21cut23:30:222
1288238992311,9cyclictest1379082-21cut23:30:222
1288235992317,3cyclictest0-21swapper/120:00:241
1288235992317,3cyclictest0-21swapper/120:00:241
128823599231,4cyclictest1302624-21apt19:50:001
1288238992216,3cyclictest0-21swapper/220:00:192
1288238992216,3cyclictest0-21swapper/220:00:192
1288238992215,4cyclictest0-21swapper/222:40:262
1288238992215,4cyclictest0-21swapper/220:50:262
1288238992215,4cyclictest0-21swapper/220:45:252
1288235992215,4cyclictest0-21swapper/123:40:231
1288235992215,3cyclictest0-21swapper/121:25:211
1288238992115,3cyclictest0-21swapper/219:35:022
1288238992114,5cyclictest311ktimers/223:45:212
1288238992114,5cyclictest311ktimers/221:00:112
1288238992114,4cyclictest311ktimers/219:28:382
1288238992114,4cyclictest1354012-21sendmail22:20:002
1288238992114,3cyclictest1345925-21fschecks_time21:55:172
1288238992112,6cyclictest0-21swapper/222:50:272
1288238992110,8cyclictest1387048-21gdbus23:55:022
128823599213,5cyclictest131rcu_preempt22:20:111
1288235992115,4cyclictest1378903-21kworker/u8:2+events_unbound23:31:181
1288235992115,4cyclictest1378903-21kworker/u8:2+events_unbound23:31:171
1288238992015,3cyclictest1316505-21apt-get20:30:102
1288238992014,4cyclictest311ktimers/223:00:212
1288238992012,4cyclictest1364389-21latency_hist22:50:022
1288238992012,4cyclictest0-21swapper/220:25:022
1288238992010,7cyclictest1354757-21cat22:20:202
1288235992014,4cyclictest1321066-21kworker/u8:3+events_unbound20:53:301
1288235992013,4cyclictest0-21swapper/121:40:171
1288238991912,5cyclictest311ktimers/221:40:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional