You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 14:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot5s.osadl.org (updated Thu May 28, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
360179995042,4cyclictest362097-21sh19:15:012
360174994841,4cyclictest431901-21munin-plugin-st22:35:001
360174994837,7cyclictest433610-21sendmail22:40:011
360184994736,7cyclictest456381-21fschecks_count23:45:153
360184994735,9cyclictest433583-21cron22:40:003
360179994640,4cyclictest433592-21latency_hist22:40:012
360179994437,5cyclictest371287-21kworker/u8:0+events_unbound20:01:242
360169994431,9cyclictest413997-21grep21:40:250
360179994337,4cyclictest474756-21sendmail00:40:002
360174994333,7cyclictest459378-21cron23:55:011
360179994231,8cyclictest311ktimers/221:05:122
360169994232,7cyclictest444012-21cat23:10:000
36016999422,19cyclictest11-21ksoftirqd/023:45:110
360169994134,5cyclictest415862-21kworker/u8:2+events_unbound21:51:330
360174994027,8cyclictest231ktimers/123:15:111
360174994027,8cyclictest231ktimers/123:15:111
360169994032,5cyclictest437006-21sh22:50:010
360169994032,5cyclictest390077-21grep20:30:260
360169994030,6cyclictest381803-21latency_hist20:10:010
360169994030,6cyclictest381803-21latency_hist20:10:010
360169994013,7cyclictest131rcu_preempt21:30:100
360184993928,7cyclictest0-21swapper/320:05:013
360174993925,11cyclictest231ktimers/119:30:141
360169993925,11cyclictest121ktimers/022:25:110
360179993828,6cyclictest0-21swapper/221:30:012
360174993831,4cyclictest364317-21audit_send_reply19:20:011
360174993828,7cyclictest231ktimers/123:30:111
360184993729,4cyclictest0-21swapper/322:20:163
360184993728,6cyclictest374779-21munin-plugin-st19:50:013
360184993727,6cyclictest0-21swapper/321:30:243
36017999378,5cyclictest131rcu_preempt22:30:122
360179993729,5cyclictest400758-21cron21:05:002
360174993730,4cyclictest416123-21sh21:50:001
360174993726,7cyclictest0-21swapper/122:10:241
360169993730,5cyclictest371287-21kworker/u8:0+events_unbound20:21:270
360169993728,7cyclictest360526-21kworker/u8:1+events_unbound19:21:160
360169993726,7cyclictest420980-21grep22:00:230
360169993724,8cyclictest0-21swapper/023:55:010
360169993719,5cyclictest131rcu_preempt21:25:120
360179993626,6cyclictest0-21swapper/200:10:012
360174993627,5cyclictest0-21swapper/121:55:251
360169993630,4cyclictest456333-21kworker/u8:2+events_unbound00:17:510
360169993630,4cyclictest456333-21kworker/u8:2+events_unbound00:17:500
360169993629,4cyclictest0-21swapper/023:05:000
360169993629,3cyclictest0-21swapper/000:40:000
360184993525,6cyclictest0-21swapper/320:45:003
360179993522,9cyclictest311ktimers/219:15:132
360174993524,7cyclictest0-21swapper/122:15:251
360174993524,7cyclictest0-21swapper/120:00:261
360174993523,9cyclictest407134-21grep21:20:241
360174993523,9cyclictest407134-21grep21:20:231
360174993519,5cyclictest421238-21kworker/u8:0+events_unbound22:04:181
360169993525,5cyclictest0-21swapper/022:15:010
360184993426,4cyclictest0-21swapper/320:50:253
360184993426,4cyclictest0-21swapper/320:30:173
360184993424,6cyclictest0-21swapper/322:25:273
360184993424,6cyclictest0-21swapper/320:35:273
360179993425,5cyclictest0-21swapper/221:51:312
360174993426,5cyclictest0-21swapper/122:10:011
360174993423,6cyclictest0-21swapper/120:20:011
360169993427,4cyclictest383518-21idleruntime-cro20:15:000
360169993426,4cyclictest0-21swapper/022:00:000
360169993424,6cyclictest426576-21sendmail22:20:010
360169993415,3cyclictest131rcu_preempt22:55:310
360169993414,7cyclictest131rcu_preempt23:55:130
360184993322,7cyclictest0-21swapper/321:05:013
360179993326,4cyclictest0-21swapper/223:50:232
360179993325,4cyclictest0-21swapper/223:20:242
360179993325,4cyclictest0-21swapper/223:20:232
360179993324,6cyclictest0-21swapper/221:35:012
360174993323,6cyclictest0-21swapper/119:55:251
360174993322,7cyclictest0-21swapper/121:05:241
360169993326,4cyclictest385423-21munin-plugin-st20:20:000
360169993324,6cyclictest448472-21grep23:20:230
360169993324,6cyclictest448472-21grep23:20:230
360169993321,3cyclictest131rcu_preempt21:14:560
360169993319,5cyclictest131rcu_preempt22:35:100
360169993316,5cyclictest408926-21kworker/u8:3-events_freezable_power_22:09:280
360169993311,12cyclictest11-21ksoftirqd/020:25:250
360184993224,5cyclictest362090-21munin-node19:15:023
360179993225,3cyclictest0-21swapper/223:30:242
360179993223,5cyclictest469165-21unixbench_multi00:20:252
360179993222,7cyclictest377765-21grep19:55:252
360174993224,5cyclictest0-21swapper/100:05:261
360174993223,6cyclictest0-21swapper/119:40:151
360174993222,6cyclictest0-21swapper/120:45:151
360174993222,6cyclictest0-21swapper/100:15:161
360174993222,6cyclictest0-21swapper/100:15:151
360169993226,4cyclictest376119-21kworker/u8:1+events_unbound19:51:220
360169993224,4cyclictest0-21swapper/022:30:230
360169993221,7cyclictest434841-21grep22:40:240
360169993220,8cyclictest412296-21grep21:35:280
360169993220,5cyclictest131rcu_preempt20:45:130
360169993216,4cyclictest131rcu_preempt23:32:190
360169993214,4cyclictest131rcu_preempt19:35:190
360169993214,10cyclictest131rcu_preempt20:50:160
360184993124,3cyclictest0-21swapper/321:35:163
360184993123,4cyclictest0-21swapper/323:25:153
360184993123,4cyclictest0-21swapper/321:20:003
360184993122,6cyclictest461504-21fschecks_count00:00:163
360184993122,5cyclictest0-21swapper/322:05:253
360179993123,4cyclictest0-21swapper/220:55:152
360179993121,7cyclictest367941-21wc19:30:022
360174993125,4cyclictest447125-21kworker/u8:0+events_unbound23:36:431
36017499312,4cyclictest131rcu_preempt21:50:101
36016999317,11cyclictest11-21ksoftirqd/000:15:000
360169993121,7cyclictest405407-21grep21:15:240
360169993121,6cyclictest0-21swapper/000:25:240
360169993120,7cyclictest0-21swapper/021:05:240
360169993115,9cyclictest131rcu_preempt23:25:200
360169993112,12cyclictest131rcu_preempt19:55:170
360169993111,10cyclictest0-21swapper/019:42:460
360184993023,4cyclictest0-21swapper/322:45:253
360184993022,4cyclictest0-21swapper/322:50:163
360184993021,5cyclictest0-21swapper/300:00:013
360184993020,6cyclictest0-21swapper/322:00:243
360184993019,7cyclictest0-21swapper/323:40:153
360184993019,7cyclictest0-21swapper/319:25:003
360179993023,4cyclictest0-21swapper/223:05:262
360179993023,4cyclictest0-21swapper/222:10:242
360179993020,7cyclictest0-21swapper/222:50:012
360174993022,5cyclictest0-21swapper/100:40:011
360174993021,4cyclictest0-21swapper/123:20:241
360174993021,4cyclictest0-21swapper/123:20:231
360174993020,6cyclictest0-21swapper/121:10:251
36016999309,6cyclictest11-21ksoftirqd/023:10:220
36016999309,6cyclictest11-21ksoftirqd/023:10:210
360169993022,5cyclictest369222-21grep19:30:280
360169993019,4cyclictest131rcu_preempt00:31:430
360169993018,8cyclictest399069-21idleruntime-cro21:00:010
360169993017,4cyclictest131rcu_preempt22:50:240
360169993016,3cyclictest131rcu_preempt20:35:430
360169993016,10cyclictest121ktimers/020:00:110
360169993012,3cyclictest131rcu_preempt19:25:210
360169993010,3cyclictest0-21swapper/019:19:570
360184992922,4cyclictest419737-21auditctl22:00:003
360184992921,4cyclictest0-21swapper/321:45:253
360184992919,6cyclictest0-21swapper/323:15:253
360184992919,6cyclictest0-21swapper/323:15:253
360184992919,6cyclictest0-21swapper/321:20:163
360184992919,6cyclictest0-21swapper/321:20:153
360184992919,6cyclictest0-21swapper/320:15:253
360179992922,4cyclictest467918-21cron00:19:592
360179992922,4cyclictest467918-21cron00:19:592
360179992921,4cyclictest0-21swapper/200:25:162
360179992920,5cyclictest0-21swapper/222:20:252
360174992922,5cyclictest371287-21kworker/u8:0+events_unbound20:11:251
360174992922,4cyclictest0-21swapper/120:55:241
360174992920,6cyclictest0-21swapper/123:10:251
360174992920,6cyclictest0-21swapper/123:10:251
360174992920,5cyclictest0-21swapper/119:40:021
36016999296,4cyclictest131rcu_preempt21:00:170
360169992919,4cyclictest131rcu_preempt22:23:200
360184992821,4cyclictest367989-21latency_hist19:30:013
360184992820,5cyclictest0-21swapper/323:30:153
360184992819,7cyclictest402481-21cut21:10:003
360184992819,6cyclictest0-21swapper/321:55:023
360184992819,6cyclictest0-21swapper/300:35:253
360184992818,6cyclictest0-21swapper/320:45:243
360179992821,4cyclictest0-21swapper/223:35:162
360179992821,3cyclictest0-21swapper/220:30:252
360179992818,6cyclictest0-21swapper/222:50:252
360174992820,5cyclictest0-21swapper/100:29:591
360174992819,6cyclictest0-21swapper/119:25:261
36016999289,5cyclictest131rcu_preempt20:40:110
36016999288,13cyclictest11-21ksoftirqd/023:20:010
36016999288,13cyclictest11-21ksoftirqd/023:20:000
36016999287,3cyclictest131rcu_preempt23:35:150
36016999285,6cyclictest11-21ksoftirqd/023:45:000
360169992811,6cyclictest131rcu_preempt00:20:240
360169992810,12cyclictest131rcu_preempt19:50:010
360184992719,4cyclictest0-21swapper/320:00:003
360184992718,6cyclictest0-21swapper/322:10:243
360184992718,6cyclictest0-21swapper/300:20:233
360184992712,12cyclictest360159-21cyclictest19:15:143
360179992721,4cyclictest385163-21sh20:17:022
360179992720,5cyclictest379741-21kworker/u8:2+events_unbound20:51:272
360179992720,4cyclictest462543-21kworker/u8:0+events_unbound00:02:392
360179992720,4cyclictest0-21swapper/222:05:012
360179992720,3cyclictest0-21swapper/219:40:242
360179992719,5cyclictest388834-21sh20:30:012
360179992719,4cyclictest0-21swapper/223:29:592
360179992716,7cyclictest419443-21sshd21:56:322
36017499277,5cyclictest131rcu_preempt21:40:111
360174992720,4cyclictest0-21swapper/119:15:021
360174992719,4cyclictest0-21swapper/123:55:251
360174992718,6cyclictest439102-21fschecks_count22:55:151
360174992716,7cyclictest0-21swapper/119:50:241
36016999279,10cyclictest11-21ksoftirqd/000:05:000
36016999278,12cyclictest11-21ksoftirqd/021:20:200
36016999278,12cyclictest11-21ksoftirqd/021:20:200
360169992721,4cyclictest462543-21kworker/u8:0-ext4-rsv-conversion00:10:000
360169992714,5cyclictest131rcu_preempt21:49:140
360184992618,4cyclictest472617-21head00:30:253
360184992617,6cyclictest0-21swapper/323:00:243
36017999266,4cyclictest4155532cat21:45:242
360179992620,4cyclictest385661-21/usr/sbin/munin20:20:242
360179992619,5cyclictest439508-21kworker/u8:1+events_unbound23:10:412
360179992619,5cyclictest439508-21kworker/u8:1+events_unbound23:10:412
360179992619,5cyclictest0-21swapper/221:10:122
360179992617,6cyclictest0-21swapper/222:15:152
360179992614,9cyclictest461113-21tr00:00:002
360179992614,8cyclictest1-21systemd20:11:252
360174992620,4cyclictest421238-21kworker/u8:0+events_unbound22:46:361
360174992619,4cyclictest0-21swapper/122:25:001
360174992619,3cyclictest0-21swapper/122:25:251
360174992617,6cyclictest0-21swapper/123:05:251
360174992616,6cyclictest0-21swapper/100:00:261
36017499260,3cyclictest0-21swapper/122:53:011
360184992519,3cyclictest0-21swapper/319:35:153
360184992518,5cyclictest379741-21kworker/u8:2+events_unbound21:26:323
360184992517,5cyclictest0-21swapper/321:45:003
360184992516,5cyclictest0-21swapper/323:05:223
360184992516,5cyclictest0-21swapper/322:41:353
360184992516,5cyclictest0-21swapper/319:30:283
360179992519,3cyclictest0-21swapper/223:40:242
360179992518,5cyclictest367334-21kworker/u8:3+events_unbound19:35:012
360179992518,5cyclictest0-21swapper/219:50:152
360179992515,7cyclictest406736-21seq21:20:212
360179992515,7cyclictest406736-21seq21:20:212
360174992517,6cyclictest231ktimers/123:45:131
360174992517,5cyclictest393618-21kworker/u8:3+events_unbound20:41:271
360174992517,5cyclictest178-21systemd-udevd21:00:401
360174992516,6cyclictest469229-21unixbench_singl00:20:241
360174992514,8cyclictest405412-21grep21:15:251
360184992417,4cyclictest0-21swapper/300:20:003
360184992417,4cyclictest0-21swapper/300:19:593
360179992418,4cyclictest410851-21kworker/u8:0+events_unbound21:36:312
360179992418,4cyclictest371287-21kworker/u8:0+events_unbound20:40:432
360179992418,3cyclictest0-21swapper/200:10:222
360179992414,6cyclictest0-21swapper/220:35:272
360179992410,10cyclictest311ktimers/222:25:122
360174992417,4cyclictest450779-21latency_hist23:30:011
360174992415,4cyclictest0-21swapper/120:25:021
360184992317,3cyclictest0-21swapper/321:15:003
360184992315,5cyclictest0-21swapper/323:35:213
360184992314,6cyclictest0-21swapper/323:10:243
360184992314,6cyclictest0-21swapper/323:10:243
360184992314,5cyclictest0-21swapper/322:55:253
360179992318,2cyclictest0-21swapper/220:05:272
360179992318,2cyclictest0-21swapper/220:05:272
360179992316,4cyclictest442126-21sh23:05:012
360179992315,5cyclictest436742-21kworker/u8:2+events_unbound23:18:062
360179992315,5cyclictest436742-21kworker/u8:2+events_unbound23:18:052
360179992314,4cyclictest0-21swapper/221:20:002
360179992313,6cyclictest0-21swapper/222:40:242
360174992317,3cyclictest0-21swapper/122:40:231
360174992317,3cyclictest0-21swapper/121:30:171
360174992317,3cyclictest0-21swapper/120:50:251
360174992317,3cyclictest0-21swapper/120:30:241
360174992317,3cyclictest0-21swapper/120:25:241
360174992317,3cyclictest0-21swapper/100:10:161
360174992315,4cyclictest0-21swapper/120:06:241
360174992315,4cyclictest0-21swapper/120:06:241
360174992314,6cyclictest0-21swapper/100:35:011
360184992216,3cyclictest0-21swapper/320:20:223
360184992214,6cyclictest465638-21sed00:10:233
360184992214,5cyclictest0-21swapper/320:55:253
360184992211,6cyclictest0-21swapper/322:15:263
360179992216,4cyclictest473039-21latency_hist00:35:012
360179992216,3cyclictest371354-21sendmail19:40:012
360179992216,3cyclictest0-21swapper/223:45:222
36017999221,3cyclictest629-21snmpd21:41:022
360179992213,6cyclictest439435-21sed22:55:192
360174992211,7cyclictest441290-21wc23:00:211
360184992115,3cyclictest0-21swapper/323:50:233
360184992113,6cyclictest145-21jbd2/mmcblk1p2-822:31:063
360184992110,8cyclictest391ktimers/320:05:073
360184992110,8cyclictest391ktimers/320:05:073
360174992115,3cyclictest0-21swapper/123:40:191
360174992115,3cyclictest0-21swapper/121:35:181
360174992112,6cyclictest0-21swapper/119:20:151
360174992111,7cyclictest409295-21sh21:30:001
360184992014,4cyclictest387361-21/usr/sbin/munin20:25:133
360184992014,3cyclictest0-21swapper/300:05:153
360184992013,4cyclictest448958-21sh23:24:593
360184992013,4cyclictest448958-21sh23:24:593
360184992013,4cyclictest0-21swapper/300:25:243
360174992011,6cyclictest0-21swapper/119:45:141
360184991913,4cyclictest343325-21kworker/u8:2+events_unbound19:41:213
360179991912,5cyclictest311ktimers/219:45:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional