You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot5s.osadl.org (updated Fri Dec 26, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
922861995244,5cyclictest961141-21kworker/u8:0+events_unbound21:08:001
922861995142,5cyclictest935359-21cron19:45:011
922860995040,6cyclictest1015697-21grep23:35:250
922860994539,4cyclictest931607-21kworker/u8:1+events_unbound19:47:450
922863994433,7cyclictest1016189-21basename23:40:003
922862994433,8cyclictest969693-21sh21:25:002
922862994431,9cyclictest942000-21grep20:00:262
922860994329,10cyclictest974323-21grep21:35:260
922860994229,8cyclictest986536-21grep22:10:270
922860994130,7cyclictest0-21swapper/022:28:160
922861994034,4cyclictest978198-21kworker/u8:2+events_unbound22:08:141
922860994029,7cyclictest940279-21head19:55:250
922860994026,8cyclictest965880-21grep21:10:290
922863993929,6cyclictest0-21swapper/321:25:013
922861993929,6cyclictest1036895-21latency_hist00:40:001
922860993933,4cyclictest950720-21kworker/u8:0+events_unbound20:37:530
922860993933,4cyclictest1000603-21kworker/u8:2+events_unbound22:58:240
922861993830,4cyclictest0-21swapper/121:45:001
922860993832,4cyclictest944880-21kworker/u8:2+events_unbound21:03:000
922860993830,4cyclictest1036841-21munin-plugin-st00:40:010
92286099381,8cyclictest11-21ksoftirqd/021:25:160
92286099381,8cyclictest11-21ksoftirqd/021:25:150
922861993729,4cyclictest0-21swapper/122:55:191
922863993627,5cyclictest0-21swapper/319:30:003
922862993627,4cyclictest0-21swapper/222:15:272
922861993627,5cyclictest0-21swapper/120:45:301
922861993626,7cyclictest947088-21grep20:15:301
922861993626,6cyclictest0-21swapper/123:45:281
922860993627,5cyclictest0-21swapper/023:20:250
922860993625,7cyclictest977817-21grep21:45:260
922863993527,4cyclictest0-21swapper/300:35:003
922863993526,4cyclictest0-21swapper/321:55:263
922863993525,4cyclictest0-21swapper/319:35:003
922863993523,6cyclictest0-21swapper/323:05:263
922862993522,8cyclictest1022732-21grep23:55:262
922861993527,6cyclictest944880-21kworker/u8:2+events_unbound20:12:471
922861993525,7cyclictest1004234-21debian-sa123:05:001
922861993524,7cyclictest983135-21grep22:00:271
922860993525,5cyclictest0-21swapper/019:37:430
922860993524,7cyclictest972673-21grep21:30:260
922860993524,7cyclictest972673-21grep21:30:260
922860993524,7cyclictest1026204-21grep00:05:300
922860993524,7cyclictest1026204-21grep00:05:290
922860993523,3cyclictest131rcu_preempt20:57:230
92286099352,16cyclictest11-21ksoftirqd/021:15:160
922863993426,4cyclictest0-21swapper/300:15:273
922863993425,4cyclictest0-21swapper/320:30:193
922862993426,4cyclictest0-21swapper/222:50:272
922862993425,6cyclictest0-21swapper/219:55:142
922861993428,4cyclictest993706-21kworker/u8:1+events_unbound22:38:201
922861993427,4cyclictest0-21swapper/100:10:281
922861993425,5cyclictest0-21swapper/100:15:161
922861993424,4cyclictest940544-21kworker/u8:1+events_unbound20:07:481
922860993427,5cyclictest1029668-21kworker/u8:0+events_unbound00:30:400
922860993424,6cyclictest0-21swapper/019:20:250
922860993424,6cyclictest0-21swapper/019:20:250
922860993421,5cyclictest131rcu_preempt19:15:030
922860993420,5cyclictest131rcu_preempt00:10:140
922863993326,4cyclictest0-21swapper/323:20:253
922863993325,4cyclictest0-21swapper/320:20:253
922862993325,4cyclictest0-21swapper/221:00:262
922862993324,6cyclictest959445-21sh20:55:002
922861993325,5cyclictest0-21swapper/123:55:251
922861993323,6cyclictest0-21swapper/121:50:001
922861993323,5cyclictest0-21swapper/123:30:181
922860993326,5cyclictest1004190-21kworker/u8:1+events_unbound23:11:400
922860993325,4cyclictest0-21swapper/000:20:260
922860993321,7cyclictest0-21swapper/022:50:000
922860993321,3cyclictest131rcu_preempt00:17:390
922860993313,6cyclictest131rcu_preempt20:20:110
922860993311,14cyclictest11-21ksoftirqd/023:50:190
922863993222,6cyclictest0-21swapper/322:40:013
922863993221,6cyclictest0-21swapper/323:55:263
922863993220,7cyclictest0-21swapper/300:40:003
922862993226,4cyclictest1005915-21kworker/u8:2+events_unbound23:28:262
922862993225,4cyclictest0-21swapper/221:50:262
922862993224,5cyclictest1033442-21ls00:29:592
922862993221,7cyclictest1010577-21grep23:20:252
922861993224,4cyclictest0-21swapper/123:40:301
922861993220,9cyclictest0-21swapper/123:10:001
922860993226,4cyclictest976156-21kworker/u8:3+events_unbound21:41:420
922860993223,5cyclictest952638-21munin-plugin-st20:35:010
922860993220,8cyclictest993780-21apt22:35:010
922860993216,5cyclictest131rcu_preempt19:50:240
922860993214,10cyclictest131rcu_preempt22:20:190
922860993213,12cyclictest131rcu_preempt20:25:270
92286099321,16cyclictest438-21cron19:35:010
922863993124,3cyclictest0-21swapper/323:30:013
922862993124,4cyclictest0-21swapper/220:55:282
922862993124,3cyclictest0-21swapper/222:00:162
922862993121,7cyclictest1018707-21wc23:45:192
922861993123,4cyclictest0-21swapper/119:17:401
922861993121,6cyclictest0-21swapper/121:25:261
922861993121,6cyclictest0-21swapper/121:25:261
922861993120,7cyclictest952228-21grep20:30:271
92286099319,14cyclictest11-21ksoftirqd/023:15:170
92286099318,3cyclictest131rcu_preempt20:40:260
922860993122,6cyclictest1013180-21fschecks_time23:30:180
922860993117,5cyclictest131rcu_preempt21:54:360
922860993110,12cyclictest131rcu_preempt20:55:010
922860993110,10cyclictest0-21swapper/023:41:020
922863993022,4cyclictest0-21swapper/322:50:183
922863993022,4cyclictest0-21swapper/321:30:253
922863993022,4cyclictest0-21swapper/321:30:253
922863993021,5cyclictest988197-21grep22:15:263
922863993019,8cyclictest391ktimers/322:00:123
922862993022,4cyclictest0-21swapper/220:05:262
922862993021,4cyclictest0-21swapper/221:30:172
922862993021,4cyclictest0-21swapper/221:30:162
922862993019,7cyclictest0-21swapper/220:20:252
922861993024,3cyclictest0-21swapper/120:40:001
922861993022,4cyclictest0-21swapper/121:20:011
922861993020,6cyclictest0-21swapper/121:35:261
922861993020,5cyclictest0-21swapper/119:35:001
922861993018,8cyclictest979712-21grep21:50:251
92286099309,11cyclictest11-21ksoftirqd/000:03:310
922860993021,7cyclictest993706-21kworker/u8:1+events_unbound22:38:410
922860993017,5cyclictest131rcu_preempt20:45:240
922860993016,4cyclictest131rcu_preempt22:50:160
922860993014,5cyclictest131rcu_preempt21:20:250
922860993012,5cyclictest131rcu_preempt23:45:210
922860993010,7cyclictest11-21ksoftirqd/000:25:230
922863992920,4cyclictest0-21swapper/323:00:003
922863992918,7cyclictest0-21swapper/321:25:283
922863992918,7cyclictest0-21swapper/321:25:273
922862992922,3cyclictest0-21swapper/221:45:262
922861992922,4cyclictest0-21swapper/122:30:011
922861992922,4cyclictest0-21swapper/121:00:261
922861992921,6cyclictest950720-21kworker/u8:0+events_unbound20:42:551
922861992920,6cyclictest981428-21grep21:55:271
922861992920,6cyclictest0-21swapper/122:10:251
922861992920,5cyclictest0-21swapper/122:40:231
92286099298,12cyclictest11-21ksoftirqd/022:15:240
922860992920,4cyclictest0-21swapper/020:00:270
922860992915,4cyclictest131rcu_preempt19:41:010
92286099291,18cyclictest11-21ksoftirqd/022:02:390
922863992821,3cyclictest0-21swapper/322:25:163
922863992820,3cyclictest0-21swapper/321:15:003
922863992819,6cyclictest1007192-21grep23:10:283
922862992822,3cyclictest0-21swapper/200:20:002
922862992821,4cyclictest0-21swapper/219:45:022
922862992821,3cyclictest0-21swapper/219:45:272
922861992820,4cyclictest0-21swapper/123:28:261
922861992819,5cyclictest0-21swapper/119:15:011
922861992819,5cyclictest0-21swapper/119:15:001
922861992817,7cyclictest0-21swapper/121:30:261
922861992817,7cyclictest0-21swapper/121:30:251
92286099288,12cyclictest11-21ksoftirqd/022:45:000
92286099288,11cyclictest131rcu_preempt20:05:180
92286099288,11cyclictest131rcu_preempt19:10:160
92286099288,11cyclictest131rcu_preempt19:10:150
92286099286,12cyclictest131rcu_preempt20:15:010
922860992822,4cyclictest1017818-21kworker/u8:1+events_unbound23:59:400
922860992822,4cyclictest1004949-21missed_timers23:05:200
922860992813,5cyclictest131rcu_preempt21:55:160
922863992721,4cyclictest928299-21kworker/u8:2+events_unbound19:22:423
922863992721,4cyclictest928299-21kworker/u8:2+events_unbound19:22:423
922863992720,3cyclictest0-21swapper/321:05:163
922863992718,6cyclictest1009491-21sed23:20:013
922863992718,5cyclictest940224-21grep19:55:243
922863992716,7cyclictest204-21dbus-daemon21:43:053
922862992721,3cyclictest0-21swapper/222:45:012
922862992720,3cyclictest0-21swapper/220:40:172
922862992719,4cyclictest0-21swapper/223:05:172
922862992717,7cyclictest1036834-21sh00:40:002
92286199279,4cyclictest0-21swapper/121:20:251
922861992716,7cyclictest0-21swapper/120:50:271
922861992715,9cyclictest231ktimers/123:15:131
922860992711,3cyclictest131rcu_preempt23:27:130
922863992620,3cyclictest0-21swapper/320:55:253
922863992618,5cyclictest0-21swapper/321:40:003
922862992620,3cyclictest0-21swapper/220:15:012
922862992619,4cyclictest0-21swapper/221:40:002
922862992619,3cyclictest0-21swapper/222:10:202
922862992619,3cyclictest0-21swapper/220:35:192
922862992618,4cyclictest0-21swapper/223:55:002
922862992618,4cyclictest0-21swapper/223:10:292
922862992617,6cyclictest0-21swapper/223:35:262
922862992610,13cyclictest922858-21cyclictest19:35:132
922861992620,4cyclictest978198-21kworker/u8:2+events_unbound22:15:071
922861992620,4cyclictest944880-21kworker/u8:2+events_unbound20:57:571
922861992613,8cyclictest1006494-21/usr/sbin/munin23:10:191
92286099267,11cyclictest11-21ksoftirqd/021:05:180
92286099266,11cyclictest11-21ksoftirqd/019:25:250
922860992617,5cyclictest0-21swapper/020:15:190
922860992614,5cyclictest131rcu_preempt23:00:200
922863992519,3cyclictest0-21swapper/300:05:233
922863992519,3cyclictest0-21swapper/300:05:233
922863992517,4cyclictest0-21swapper/320:10:173
922863992516,6cyclictest0-21swapper/319:10:253
922863992516,6cyclictest0-21swapper/319:10:243
922862992519,3cyclictest0-21swapper/222:45:232
922862992519,3cyclictest0-21swapper/220:25:182
922862992519,3cyclictest0-21swapper/200:20:222
922862992518,4cyclictest0-21swapper/219:10:152
922862992518,4cyclictest0-21swapper/219:10:152
922862992517,5cyclictest0-21swapper/223:30:192
922862992515,7cyclictest995057-21grep22:35:262
922862992515,7cyclictest967090-21ntp_states21:15:252
922862992514,8cyclictest981054-21sendmail_mailqu21:55:242
92286199256,5cyclictest131rcu_preempt22:25:001
922861992519,4cyclictest1015867-21kworker/u8:0+events_unbound23:38:281
922861992516,6cyclictest1020236-21seq23:50:181
92286199251,18cyclictest0-21swapper/120:20:121
92286099256,11cyclictest131rcu_preempt22:05:180
922863992419,2cyclictest0-21swapper/322:50:003
922863992418,3cyclictest0-21swapper/320:50:003
922863992417,4cyclictest933653-21sendmail19:40:013
922863992416,4cyclictest0-21swapper/322:10:263
922863992416,4cyclictest0-21swapper/300:10:283
922863992415,6cyclictest1003822-21grep23:00:293
922863992414,6cyclictest959017-21grep20:50:263
922862992418,3cyclictest0-21swapper/222:20:252
922862992417,4cyclictest0-21swapper/200:00:252
922862992414,7cyclictest1002862-21ls23:00:152
92286199248,8cyclictest131rcu_preempt19:50:201
922861992418,4cyclictest1033137-21kworker/u8:1+events_unbound00:34:461
922861992416,5cyclictest0-21swapper/119:50:011
922861992416,4cyclictest0-21swapper/123:20:211
922861992413,8cyclictest1023602-21tune2fs00:00:151
922863992317,3cyclictest0-21swapper/320:00:223
922863992316,4cyclictest0-21swapper/300:00:223
922863992315,4cyclictest954358-21sendmail-msp20:40:013
92286399231,19cyclictest1031976-21chrt00:25:133
922862992317,4cyclictest963645-21ntpq21:05:212
922862992317,3cyclictest0-21swapper/223:15:232
922862992317,3cyclictest0-21swapper/222:30:182
922862992317,3cyclictest0-21swapper/222:25:252
922862992317,3cyclictest0-21swapper/221:25:242
922862992317,3cyclictest0-21swapper/221:25:232
922862992316,5cyclictest0-21swapper/220:20:002
922862992316,4cyclictest951729-21ntpq20:30:232
922862992315,6cyclictest1033137-21kworker/u8:1+events_unbound00:34:432
922862992315,5cyclictest0-21swapper/221:45:002
922862992314,6cyclictest1016860-21tune2fs23:40:212
922861992318,3cyclictest1030519-21idleruntime00:20:171
92286199231,7cyclictest1000168-21sed22:50:271
922861992315,4cyclictest0-21swapper/119:35:271
922861992311,9cyclictest24-21ksoftirqd/122:30:191
922863992216,3cyclictest0-21swapper/322:20:203
922863992216,3cyclictest0-21swapper/320:05:263
922863992215,3cyclictest0-21swapper/322:30:253
922863992214,5cyclictest0-21swapper/322:05:273
922862992216,3cyclictest0-21swapper/220:45:282
922862992215,5cyclictest929877-21kworker/u8:3+events_unbound19:29:482
922862992215,5cyclictest0-21swapper/222:05:202
922862992214,6cyclictest965690-21wc21:10:282
922862992214,5cyclictest0-21swapper/223:00:002
922861992216,4cyclictest997300-21kworker/u8:0+events_unbound22:46:281
922861992215,3cyclictest0-21swapper/119:25:261
922863992115,3cyclictest0-21swapper/321:45:173
922863992115,3cyclictest0-21swapper/320:25:163
922863992115,3cyclictest0-21swapper/319:15:173
922863992113,5cyclictest0-21swapper/319:45:023
922863992113,4cyclictest1019794-21latency_hist23:50:003
922863992112,6cyclictest979010-21cut21:50:183
922863992112,6cyclictest966895-21grep21:15:213
922863992112,6cyclictest1030810-21tr00:20:213
922863992112,6cyclictest0-21swapper/321:00:273
922863992112,6cyclictest0-21swapper/320:20:003
922863992111,6cyclictest391ktimers/322:40:243
92286299212,15cyclictest1026205-21grep00:05:292
92286299212,15cyclictest1026205-21grep00:05:292
922862992114,4cyclictest928065-21tail19:20:262
922862992114,4cyclictest928065-21tail19:20:262
922862992113,5cyclictest0-21swapper/219:50:152
922862992112,6cyclictest931171-21expr19:30:232
922861992116,2cyclictest24-21ksoftirqd/120:25:251
922861992115,4cyclictest938791-21kworker/u8:2+events_unbound19:57:351
922861992113,4cyclictest0-21swapper/100:05:301
922861992113,4cyclictest0-21swapper/100:05:301
922861992111,5cyclictest0-21swapper/121:10:191
92286399208,8cyclictest1013987-21grep23:30:273
922862992013,4cyclictest645-21runrttasks00:10:192
922861992013,4cyclictest942391-21cron20:05:001
922863991914,3cyclictest1020199-21fschecks_count23:50:193
922863991812,4cyclictest391ktimers/320:40:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional