You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 21:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Fri Mar 27, 2026 12:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
157352995442,7cyclictest229710-21grep10:35:252
157348994531,10cyclictest231ktimers/108:20:101
157344994534,7cyclictest178097-21grep08:05:270
157344994532,9cyclictest165937-21grep07:30:260
157356994433,8cyclictest161300-21sendmail07:20:013
157352994431,10cyclictest311ktimers/210:30:132
157348994433,8cyclictest438-21cron08:50:011
157348994332,7cyclictest249302-21fschecks_count11:35:171
157356994235,4cyclictest174965-21idleruntime-cro08:00:003
157352994234,5cyclictest255519-21kworker/u8:0+events_unbound12:05:122
157352994234,5cyclictest255519-21kworker/u8:0+events_unbound12:05:122
157348994231,8cyclictest268136-21apt-get12:30:131
157348994231,8cyclictest268136-21apt-get12:30:131
157344994235,4cyclictest252334-21cron11:45:000
157344994225,11cyclictest121ktimers/008:15:120
157348994131,7cyclictest263851-21unixbench_singl12:15:241
157356994028,8cyclictest207774-21sh09:35:013
157348994032,4cyclictest223152-21sendmail10:20:001
157344994029,7cyclictest195364-21grep08:55:260
157356993928,8cyclictest391ktimers/311:45:123
157356993831,3cyclictest0-21swapper/311:20:003
157348993830,5cyclictest219735-21idleruntime-cro10:10:001
157356993730,5cyclictest216039-21kworker/u8:0+events_unbound10:04:473
157356993729,4cyclictest0-21swapper/310:25:153
157356993728,5cyclictest0-21swapper/307:55:003
157356993728,5cyclictest0-21swapper/307:55:003
157356993727,6cyclictest0-21swapper/308:35:253
157356993719,5cyclictest131rcu_preempt09:25:013
157352993726,7cyclictest255264-21grep11:50:232
15734499371,32cyclictest232271-21cut10:45:150
157356993630,4cyclictest157503-21kworker/u8:3+events_unbound07:39:203
157356993628,5cyclictest229732-21unixbench_singl10:35:253
157348993625,6cyclictest0-21swapper/108:35:011
157344993628,4cyclictest0-21swapper/012:10:000
157344993628,4cyclictest0-21swapper/012:09:590
157356993529,4cyclictest157503-21kworker/u8:3+events_unbound08:04:243
157356993527,4cyclictest0-21swapper/310:30:263
157356993524,4cyclictest131rcu_preempt10:23:443
157356993522,4cyclictest131rcu_preempt10:11:343
157352993525,6cyclictest0-21swapper/207:55:002
157352993525,6cyclictest0-21swapper/207:54:592
157348993526,4cyclictest248490-21head11:30:231
157348993525,6cyclictest0-21swapper/107:15:001
157348993523,8cyclictest0-21swapper/110:00:011
157344993528,4cyclictest164708-21sh07:30:010
157344993528,4cyclictest164708-21sh07:30:010
157344993527,4cyclictest0-21swapper/009:00:250
157344993527,4cyclictest0-21swapper/009:00:250
157344993526,4cyclictest0-21swapper/011:25:060
157356993428,4cyclictest245425-21kworker/u8:1+events_unbound11:28:413
157356993428,4cyclictest133935-21kworker/u8:0+events_unbound07:20:423
157356993420,7cyclictest251970-21kworker/u8:2+events_unbound12:06:433
157356993420,7cyclictest251970-21kworker/u8:2+events_unbound12:06:423
157356993419,4cyclictest131rcu_preempt09:04:083
157356993419,4cyclictest131rcu_preempt09:04:073
157356993417,9cyclictest131rcu_preempt07:29:163
157356993417,9cyclictest131rcu_preempt07:29:153
157356993415,4cyclictest131rcu_preempt09:55:513
157356993413,4cyclictest131rcu_preempt12:03:353
157352993426,4cyclictest0-21swapper/210:55:162
157352993425,5cyclictest0-21swapper/211:20:242
157352993425,4cyclictest0-21swapper/207:30:162
157348993426,5cyclictest168115-21munin-run07:40:001
157348993424,5cyclictest0-21swapper/110:40:241
157348993422,6cyclictest0-21swapper/107:59:211
157356993320,4cyclictest131rcu_preempt09:50:093
157356993318,4cyclictest131rcu_preempt08:21:503
157356993317,4cyclictest131rcu_preempt07:30:263
157356993316,9cyclictest131rcu_preempt08:25:483
157356993316,4cyclictest131rcu_preempt08:58:083
157356993315,9cyclictest131rcu_preempt12:15:593
157356993312,5cyclictest131rcu_preempt11:40:013
15735699331,17cyclictest0-21swapper/308:05:233
157352993323,6cyclictest159091-21grep07:15:012
157348993325,4cyclictest0-21swapper/111:45:001
157348993324,4cyclictest0-21swapper/108:05:271
157348993322,8cyclictest231ktimers/108:55:121
157348993322,7cyclictest0-21swapper/112:25:161
157344993325,4cyclictest0-21swapper/011:35:000
157344993317,13cyclictest216340-21sendmail10:00:010
157356993225,4cyclictest381rcuc/308:40:223
157356993225,4cyclictest0-21swapper/311:00:013
157356993220,4cyclictest131rcu_preempt10:18:323
157356993217,3cyclictest131rcu_preempt12:10:163
157356993217,3cyclictest131rcu_preempt12:10:163
157356993216,4cyclictest131rcu_preempt08:33:193
157356993214,10cyclictest131rcu_preempt09:35:223
157356993213,4cyclictest131rcu_preempt11:13:243
157356993212,11cyclictest131rcu_preempt12:20:223
157356993211,4cyclictest131rcu_preempt11:06:463
157356993211,12cyclictest40-21ksoftirqd/307:15:013
157348993225,4cyclictest161282-21apt07:20:011
157348993223,4cyclictest0-21swapper/107:30:261
157348993222,5cyclictest0-21swapper/107:20:151
157348993221,6cyclictest220949-21grep10:10:261
157344993222,6cyclictest166778-21fschecks_count07:35:150
15735699318,14cyclictest40-21ksoftirqd/312:30:233
15735699318,14cyclictest40-21ksoftirqd/312:30:233
157356993122,7cyclictest218391-21fschecks_count10:05:153
157356993121,7cyclictest211590-21fschecks_count09:45:163
157356993120,4cyclictest131rcu_preempt12:25:123
157356993117,4cyclictest131rcu_preempt08:14:473
157356993115,4cyclictest131rcu_preempt09:18:573
157356993115,4cyclictest131rcu_preempt08:17:163
157356993114,5cyclictest131rcu_preempt09:10:193
157356993114,3cyclictest131rcu_preempt07:45:203
157356993114,3cyclictest131rcu_preempt07:45:193
157356993113,9cyclictest131rcu_preempt08:45:523
157356993112,9cyclictest131rcu_preempt12:36:183
157356993112,9cyclictest131rcu_preempt12:36:183
157356993112,5cyclictest131rcu_preempt10:40:213
157356993112,10cyclictest131rcu_preempt09:25:213
157356993111,10cyclictest40-21ksoftirqd/310:50:163
157356993110,14cyclictest40-21ksoftirqd/311:55:263
157356993110,14cyclictest40-21ksoftirqd/311:20:213
157352993125,4cyclictest270905-21unixbench_singl12:35:242
157352993125,4cyclictest270905-21unixbench_singl12:35:242
157352993122,5cyclictest0-21swapper/208:30:172
157352993121,7cyclictest247592-21fschecks_count11:30:142
157352993120,8cyclictest311ktimers/209:00:122
157352993120,8cyclictest311ktimers/209:00:122
157344993125,4cyclictest255519-21kworker/u8:0+events_unbound11:55:120
157344993121,6cyclictest0-21swapper/012:05:000
15734499311,4cyclictest131rcu_preempt10:05:120
15735699309,14cyclictest40-21ksoftirqd/311:40:233
157356993015,12cyclictest391ktimers/309:06:293
157356993015,12cyclictest391ktimers/309:06:293
157356993013,4cyclictest131rcu_preempt11:30:293
157356993012,11cyclictest131rcu_preempt10:46:403
157356993011,10cyclictest131rcu_preempt11:50:113
157352993023,4cyclictest209491-21munin-plugin-st09:40:012
157352993021,6cyclictest204-21dbus-daemon12:15:152
157352993021,4cyclictest0-21swapper/208:35:222
157348993020,7cyclictest438-21cron11:50:001
157348993017,10cyclictest181994-21basename08:20:011
157344993024,3cyclictest236985-21kthreadd11:00:010
157344993024,3cyclictest13550irq/42-30be0000.ethernet09:45:010
157344993022,4cyclictest0-21swapper/009:20:230
157344993022,4cyclictest0-21swapper/008:39:290
157344993022,4cyclictest0-21swapper/007:15:010
157344993019,9cyclictest11-21ksoftirqd/010:10:120
157356992918,4cyclictest131rcu_preempt08:50:153
157356992912,4cyclictest131rcu_preempt07:43:253
157352992922,4cyclictest0-21swapper/207:45:252
157352992922,4cyclictest0-21swapper/207:45:252
157352992920,5cyclictest198793-21grep09:05:252
157352992920,5cyclictest198793-21grep09:05:252
157352992919,6cyclictest250621-21apt11:40:002
157348992921,6cyclictest157503-21kworker/u8:3+events_unbound07:40:421
157348992917,8cyclictest241576-21cat11:10:251
157344992922,4cyclictest0-21swapper/010:30:260
157344992921,4cyclictest0-21swapper/007:55:250
157344992920,6cyclictest223125-21sh10:20:000
157344992918,8cyclictest254051-21basename11:50:000
157356992811,9cyclictest131rcu_preempt11:00:143
157352992821,4cyclictest0-21swapper/209:15:252
157352992820,4cyclictest0-21swapper/211:45:162
157352992818,7cyclictest0-21swapper/212:00:122
157352992818,6cyclictest0-21swapper/211:00:152
157348992820,4cyclictest0-21swapper/109:40:001
157348992819,6cyclictest0-21swapper/111:55:251
157348992818,6cyclictest1-21systemd12:10:151
157348992818,6cyclictest1-21systemd12:10:151
157348992817,7cyclictest0-21swapper/112:35:241
157348992817,7cyclictest0-21swapper/112:35:231
157348992817,7cyclictest0-21swapper/112:05:001
157344992821,5cyclictest157503-21kworker/u8:3+events_unbound08:24:260
157344992821,4cyclictest262223-21kworker/u8:0+events_unbound12:21:390
157344992821,4cyclictest0-21swapper/008:30:260
157352992720,4cyclictest0-21swapper/207:40:162
157352992719,5cyclictest0-21swapper/207:40:012
157352992718,6cyclictest0-21swapper/208:25:012
157352992717,6cyclictest0-21swapper/211:05:252
157352992715,8cyclictest204-21dbus-daemon12:25:172
157348992718,6cyclictest255300-21unixbench_multi11:50:241
157348992717,7cyclictest204378-21auditctl09:25:011
157348992717,6cyclictest0-21swapper/108:40:011
157344992723,2cyclictest13550irq/42-30be0000.ethernet12:30:140
157344992723,2cyclictest13550irq/42-30be0000.ethernet12:30:140
157344992723,2cyclictest13550irq/42-30be0000.ethernet08:00:010
157344992720,5cyclictest185075-21kworker/u8:0+events_unbound08:28:420
157344992720,4cyclictest242335-21apt-get11:15:110
157344992720,3cyclictest0-21swapper/012:40:000
157344992720,3cyclictest0-21swapper/012:40:000
157344992719,5cyclictest209009-21unixbench_multi09:35:250
157344992719,4cyclictest0-21swapper/011:10:240
157344992715,8cyclictest250159-21grep11:35:270
157352992619,4cyclictest180274-21munin-plugin-st08:15:012
157352992619,3cyclictest0-21swapper/212:30:202
157352992619,3cyclictest0-21swapper/212:30:192
157352992617,6cyclictest1-21systemd08:44:292
157352992617,6cyclictest0-21swapper/210:10:262
157352992617,4cyclictest0-21swapper/210:45:252
157348992618,5cyclictest200905-21kworker/u8:2+events_unbound09:34:401
157348992618,4cyclictest0-21swapper/109:14:591
157348992617,6cyclictest0-21swapper/111:15:251
157348992617,5cyclictest0-21swapper/112:20:151
157348992617,5cyclictest0-21swapper/109:25:251
157348992613,7cyclictest0-21swapper/110:50:251
157344992620,3cyclictest13850irq/36-mmc108:55:010
157344992619,5cyclictest222889-21kworker/u8:0+events_unbound11:23:290
157352992518,3cyclictest0-21swapper/209:30:272
157352992517,5cyclictest0-21swapper/207:30:012
157352992517,5cyclictest0-21swapper/207:30:002
157352992517,4cyclictest213340-21fschecks_time09:50:162
157352992516,6cyclictest0-21swapper/209:20:232
157352992515,6cyclictest0-21swapper/210:40:242
157348992517,4cyclictest0-21swapper/110:20:161
157348992517,4cyclictest0-21swapper/109:00:251
157348992517,4cyclictest0-21swapper/109:00:251
157348992515,6cyclictest0-21swapper/110:55:251
157348992514,7cyclictest214193-21grep09:50:251
15734499259,14cyclictest255935-21latency_hist11:55:010
15734499252,4cyclictest231315-21ls10:40:220
157344992521,2cyclictest13550irq/42-30be0000.ethernet09:30:240
157344992519,4cyclictest157337-21cyclictest09:27:120
157344992519,3cyclictest13850irq/36-mmc112:15:000
157344992519,3cyclictest13850irq/36-mmc112:15:000
157344992518,3cyclictest0-21swapper/007:45:240
157344992518,3cyclictest0-21swapper/007:45:240
157344992510,13cyclictest121ktimers/010:20:170
157352992418,3cyclictest0-21swapper/211:55:232
157352992418,3cyclictest0-21swapper/208:25:152
157352992418,3cyclictest0-21swapper/208:00:122
157352992417,4cyclictest0-21swapper/210:00:242
157352992416,5cyclictest0-21swapper/209:55:152
157352992416,5cyclictest0-21swapper/209:40:162
157352992416,4cyclictest0-21swapper/211:40:252
157348992417,4cyclictest176866-21cron08:05:011
157348992417,4cyclictest0-21swapper/109:45:261
157348992415,6cyclictest2166412sleep110:00:131
157348992413,8cyclictest198347-21ntp_states09:05:221
157348992413,8cyclictest198347-21ntp_states09:05:221
15734499246,3cyclictest0-21swapper/009:11:170
157344992414,7cyclictest229157-21sed10:35:200
157344992414,5cyclictest0-21swapper/009:54:440
15734499241,19cyclictest0-21swapper/009:06:240
15734499241,19cyclictest0-21swapper/009:06:240
15734499241,19cyclictest0-21swapper/008:43:110
157352992315,5cyclictest193920-21munin-plugin-st08:55:012
157352992314,5cyclictest311ktimers/208:45:232
157348992316,3cyclictest0-21swapper/111:25:001
157348992315,6cyclictest209128-21kworker/u8:0+events_unbound09:44:521
157348992314,6cyclictest0-21swapper/110:30:001
157348992311,7cyclictest0-21swapper/108:10:261
157344992316,5cyclictest0-21swapper/009:18:150
157344992316,3cyclictest0-21swapper/010:53:480
157344992315,6cyclictest121ktimers/007:15:200
157344992314,6cyclictest121ktimers/009:45:230
15734499231,2cyclictest0-21swapper/007:20:100
157344992312,7cyclictest179838-21grep08:10:260
15734499231,18cyclictest0-21swapper/011:04:570
15734499231,18cyclictest0-21swapper/007:40:540
15734499230,19cyclictest0-21swapper/008:46:140
157352992217,3cyclictest0-21swapper/210:15:132
157352992216,3cyclictest0-21swapper/210:50:142
157352992216,3cyclictest0-21swapper/208:20:002
157352992215,5cyclictest178-21systemd-udevd10:26:392
157352992215,5cyclictest178-21systemd-udevd07:20:402
157352992214,5cyclictest0-21swapper/210:20:162
157352992214,4cyclictest0-21swapper/208:55:262
157352992213,6cyclictest0-21swapper/211:10:252
157348992215,4cyclictest231ktimers/108:50:221
157348992215,4cyclictest0-21swapper/110:30:221
157348992215,3cyclictest0-21swapper/111:25:241
157344992216,3cyclictest0-21swapper/010:00:170
157344992215,3cyclictest0-21swapper/012:18:240
157344992215,3cyclictest0-21swapper/007:53:110
157344992215,3cyclictest0-21swapper/007:53:110
157352992115,3cyclictest266119-21latency_hist12:25:002
157352992115,3cyclictest0-21swapper/209:10:202
157352992115,3cyclictest0-21swapper/207:15:162
15735299211,12cyclictest645-21runrttasks08:07:122
157348992115,4cyclictest222889-21kworker/u8:0+events_unbound10:46:411
157348992113,5cyclictest260856-21cron12:10:001
157348992113,5cyclictest260856-21cron12:10:001
157348992113,5cyclictest0-21swapper/107:25:221
157348992113,5cyclictest0-21swapper/107:25:221
157348992111,6cyclictest0-21swapper/107:50:261
157348992111,6cyclictest0-21swapper/107:50:261
15734899210,12cyclictest0-21swapper/111:03:391
157352992013,5cyclictest178-21systemd-udevd09:46:402
157352992012,4cyclictest243373-21unixbench_singl11:15:252
157352992011,6cyclictest311ktimers/211:25:182
157352992011,6cyclictest0-21swapper/212:10:132
157352992011,6cyclictest0-21swapper/212:10:122
15734899201,5cyclictest0-21swapper/111:05:121
157348992014,3cyclictest0-21swapper/109:15:131
157348992010,6cyclictest0-21swapper/108:40:201
157352991910,7cyclictest219857-21sed10:10:012
157348991913,3cyclictest0-21swapper/108:25:141
157348991912,4cyclictest230190-21idleruntime-cro10:40:001
157352991812,4cyclictest204920-21if_eth109:25:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional