You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 20:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun May 10, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32657211895,18sleep00-21swapper/007:08:100
31581211283,6sleep10-21swapper/107:05:151
32748210586,14sleep20-21swapper/207:09:212
32702210594,6sleep30-21swapper/307:08:453
47802790,0sleep20-21swapper/210:06:022
93572780,1sleep20-21swapper/208:50:112
254282720,1sleep30-21swapper/309:53:373
245322660,0sleep00-21swapper/009:52:090
36599251,22cyclictest21980-21ssh09:15:112
36799220,20cyclictest0-21swapper/308:50:103
36599221,3cyclictest7825-21ssh10:45:112
36299220,3cyclictest7642-21ssh11:20:071
36199221,19cyclictest0-21swapper/011:15:110
36599210,19cyclictest0-21swapper/211:15:112
36599210,16cyclictest0-21swapper/211:06:042
36299211,3cyclictest13119-21cut12:35:391
36299210,3cyclictest27088-21grep09:20:141
36299210,3cyclictest26865-21ssh10:30:141
36299210,3cyclictest12275-21df12:00:111
36299210,3cyclictest0-21swapper/112:21:351
36299210,3cyclictest0-21swapper/112:10:151
36299210,3cyclictest0-21swapper/108:55:181
36299210,2cyclictest0-21swapper/112:05:511
36299210,2cyclictest0-21swapper/108:50:061
36299210,2cyclictest0-21swapper/108:10:501
36299210,2cyclictest0-21swapper/107:30:131
36299210,19cyclictest17813-21missed_timers10:20:161
46212200,1sleep10-21swapper/111:51:031
36799200,18cyclictest0-21swapper/312:10:093
36599203,2cyclictest0-21swapper/211:41:052
365992017,2cyclictest8106-21kworker/u8:109:43:042
365992017,2cyclictest29142-21kworker/u8:010:41:042
365992017,2cyclictest10479-21kworker/u8:011:34:042
36599200,2cyclictest0-21swapper/212:10:092
36299201,3cyclictest0-21swapper/110:35:181
36299201,17cyclictest0-21swapper/109:31:031
36299201,17cyclictest0-21swapper/109:31:021
36299200,3cyclictest29892-21fschecks_time08:20:141
36299200,3cyclictest26071-21runrttasks09:19:421
36299200,3cyclictest2169-21copy12:25:031
36299200,3cyclictest0-21swapper/109:50:151
36299200,3cyclictest0-21swapper/109:45:141
36299200,3cyclictest0-21swapper/108:45:101
36299200,3cyclictest0-21swapper/108:05:141
36299200,2cyclictest0-21swapper/110:53:221
36299200,2cyclictest0-21swapper/109:00:511
36199201,2cyclictest0-21swapper/012:10:090
36799190,17cyclictest0-21swapper/308:35:123
365991916,2cyclictest3107-21kworker/u8:110:11:042
365991916,2cyclictest30745-21kworker/u8:207:10:052
365991916,2cyclictest19612-21kworker/u8:212:20:052
365991916,2cyclictest19344-21kworker/u8:009:21:042
365991916,2cyclictest18340-21kworker/u8:211:14:052
365991916,2cyclictest14559-21kworker/u8:012:15:042
36299191,3cyclictest4792-21mailstats10:41:021
36299191,3cyclictest26247-21forks12:15:141
36299191,3cyclictest0-21swapper/110:10:051
36299191,3cyclictest0-21swapper/107:16:021
36299190,3cyclictest7921-21ssh11:55:151
36299190,3cyclictest31425-21grep10:00:141
36299190,3cyclictest24617-21sh11:38:271
36299190,3cyclictest17056-21diskmemload10:46:341
36299190,3cyclictest0-21swapper/111:06:551
36299190,3cyclictest0-21swapper/109:40:141
36299190,3cyclictest0-21swapper/108:15:181
36299190,2cyclictest318692chrt11:10:221
36299190,2cyclictest0-21swapper/111:16:391
36299190,2cyclictest0-21swapper/111:00:101
36299190,2cyclictest0-21swapper/108:35:301
36299190,17cyclictest0-21swapper/109:35:111
311292190,1sleep2301ktimersoftd/210:00:132
367991815,2cyclictest8106-21kworker/u8:109:45:063
367991815,2cyclictest10479-21kworker/u8:011:26:013
365991815,2cyclictest8106-21kworker/u8:109:51:052
365991815,2cyclictest8106-21kworker/u8:109:39:042
365991815,2cyclictest13078-21kworker/u8:107:55:042
36599180,2cyclictest0-21swapper/209:26:052
36299181,3cyclictest902-21munin-node1
36299181,15cyclictest10954-21munin-node1
36299181,15cyclictest0-21swapper/109:56:051
36299181,15cyclictest0-21swapper/109:05:141
36299181,15cyclictest0-21swapper/108:41:021
36299180,3cyclictest607-21munin-node1
36299180,2cyclictest17188-21apt-get07:50:141
36299180,2cyclictest0-21swapper/112:32:031
36299180,2cyclictest0-21swapper/110:06:581
36299180,16cyclictest17380-21if_err_eth011:30:171
367991714,2cyclictest7210-21kworker/u8:212:34:043
367991714,2cyclictest1124-21kworker/u8:011:50:043
36799171,14cyclictest0-21swapper/310:55:143
365991714,2cyclictest32056-21kworker/u8:208:27:042
365991714,2cyclictest24262-21kworker/u8:110:30:042
365991714,2cyclictest2309-21kworker/u8:111:22:042
365991714,2cyclictest13078-21kworker/u8:107:46:042
365991714,2cyclictest10479-21kworker/u8:011:25:042
36299171,3cyclictest26773-21chrt11:40:171
36299171,3cyclictest0-21swapper/107:45:111
36299171,14cyclictest0-21swapper/107:56:001
36299170,3cyclictest317942sleep108:25:141
36299170,3cyclictest12184-21munin-node1
36299170,2cyclictest0-21swapper/111:47:071
36299170,2cyclictest0-21swapper/110:56:341
36299170,2cyclictest0-21swapper/109:25:111
36299170,15cyclictest0-21swapper/110:25:121
36299170,15cyclictest0-21swapper/107:26:021
367991613,2cyclictest18340-21kworker/u8:211:00:053
367991613,2cyclictest17408-21kworker/u8:112:06:043
367991613,2cyclictest17408-21kworker/u8:111:57:043
36799160,14cyclictest0-21swapper/307:10:113
365991613,2cyclictest6641-21kworker/u8:108:47:042
365991613,2cyclictest6641-21kworker/u8:108:42:052
365991613,2cyclictest2489-21kworker/u8:009:47:042
365991613,2cyclictest21349-21kworker/u8:210:19:042
365991613,2cyclictest20742-21kworker/u8:008:39:042
365991613,2cyclictest17408-21kworker/u8:111:59:042
365991613,2cyclictest17408-21kworker/u8:111:52:042
36599160,11cyclictest0-21swapper/208:56:052
36299161,2cyclictest12980-21apt-get07:40:101
36299161,2cyclictest0-21swapper/110:15:021
36299161,2cyclictest0-21swapper/109:12:161
36299160,14cyclictest21249-21munin-node1
367991512,2cyclictest3198-21kworker/u8:210:45:043
367991512,2cyclictest29142-21kworker/u8:010:52:053
367991510,3cyclictest23752-21ssh11:37:013
367991510,3cyclictest16364-21apt-get11:30:053
36799150,4cyclictest0-21swapper/310:31:013
36799150,2cyclictest27840-21rm11:41:043
36599152,7cyclictest0-21swapper/207:50:012
36599151,3cyclictest20593-21sh12:09:272
365991512,2cyclictest9285-21kworker/u8:110:50:052
365991512,2cyclictest32056-21kworker/u8:208:34:042
365991512,2cyclictest28868-21kworker/u8:108:22:052
365991512,2cyclictest2630-21kworker/u8:307:25:052
365991512,2cyclictest2630-21kworker/u8:307:22:042
365991512,2cyclictest24322-21kworker/u8:108:08:042
365991512,2cyclictest20742-21kworker/u8:008:00:042
365991512,2cyclictest14735-21kworker/u8:009:02:042
365991510,3cyclictest0-21swapper/210:26:252
36599150,2cyclictest0-21swapper/210:59:042
36599150,13cyclictest0-21swapper/212:00:232
36599150,13cyclictest0-21swapper/210:24:032
36299151,4cyclictest5694-21tr07:20:161
36199151,12cyclictest2581-21apt-get11:50:110
36199151,12cyclictest21638-21df_inode08:00:130
36199150,3cyclictest0-21swapper/010:28:110
36199150,13cyclictest0-21swapper/011:35:150
36199150,13cyclictest0-21swapper/008:30:000
36199150,13cyclictest0-21swapper/008:11:010
367991411,2cyclictest8106-21kworker/u8:109:38:063
367991411,2cyclictest6641-21kworker/u8:108:49:043
367991411,2cyclictest31504-21kworker/u8:012:23:043
367991411,2cyclictest28652-21kworker/u8:109:24:043
367991411,2cyclictest2489-21kworker/u8:009:41:043
367991411,2cyclictest21349-21kworker/u8:210:14:043
367991411,2cyclictest17408-21kworker/u8:111:45:043
36799140,13cyclictest0-21swapper/309:10:143
36799140,12cyclictest0-21swapper/309:25:113
365991411,2cyclictest2630-21kworker/u8:307:34:042
365991411,2cyclictest10811-21kworker/u8:209:06:052
365991411,2cyclictest10063-21kworker/u8:007:42:042
36599140,12cyclictest17056-21diskmemload11:03:572
36199141,2cyclictest1018-21ssh11:47:510
361991411,2cyclictest0-21swapper/009:36:210
361991411,2cyclictest0-21swapper/008:50:110
361991410,2cyclictest17687-21ssh10:20:150
36199140,2cyclictest0-21swapper/011:08:410
36199140,2cyclictest0-21swapper/011:03:210
36199140,2cyclictest0-21swapper/007:51:050
36199140,12cyclictest3858-21python07:16:020
36199140,12cyclictest19239-21ssh12:07:120
36199140,12cyclictest16942-21ssh09:44:500
36199140,12cyclictest0-21swapper/012:03:360
36199140,12cyclictest0-21swapper/011:10:140
36199140,12cyclictest0-21swapper/010:39:310
36199140,12cyclictest0-21swapper/010:15:150
36199140,12cyclictest0-21swapper/010:07:120
367991310,2cyclictest30745-21kworker/u8:207:20:013
367991310,2cyclictest29314-21kworker/u8:011:09:043
367991310,2cyclictest24262-21kworker/u8:110:38:043
367991310,2cyclictest24262-21kworker/u8:110:28:053
367991310,2cyclictest21349-21kworker/u8:210:23:043
367991310,2cyclictest21349-21kworker/u8:210:17:043
367991310,2cyclictest18340-21kworker/u8:211:15:053
367991310,2cyclictest0-21swapper/310:00:163
36799130,11cyclictest0-21swapper/307:30:173
36599138,3cyclictest17366-21rm09:10:102
365991310,2cyclictest0-21swapper/212:37:302
365991310,2cyclictest0-21swapper/212:30:352
36599130,2cyclictest0-21swapper/212:26:042
36599130,2cyclictest0-21swapper/211:47:042
36599130,2cyclictest0-21swapper/211:37:042
36599130,2cyclictest0-21swapper/209:55:082
36599130,2cyclictest0-21swapper/208:15:052
36599130,12cyclictest0-21swapper/210:37:002
361991310,2cyclictest17056-21diskmemload09:58:310
361991310,2cyclictest0-21swapper/012:20:190
361991310,2cyclictest0-21swapper/012:15:070
361991310,2cyclictest0-21swapper/011:29:410
361991310,2cyclictest0-21swapper/010:48:110
361991310,2cyclictest0-21swapper/010:34:020
361991310,2cyclictest0-21swapper/009:31:110
361991310,2cyclictest0-21swapper/009:31:110
361991310,2cyclictest0-21swapper/009:22:590
361991310,2cyclictest0-21swapper/009:15:210
361991310,2cyclictest0-21swapper/008:55:020
361991310,2cyclictest0-21swapper/007:45:110
361991310,2cyclictest0-21swapper/007:25:110
36199130,2cyclictest0-21swapper/012:31:000
36199130,2cyclictest0-21swapper/010:53:480
36199130,2cyclictest0-21swapper/010:00:120
36199130,2cyclictest0-21swapper/009:12:490
36199130,2cyclictest0-21swapper/007:10:160
36199130,12cyclictest0-21swapper/012:27:380
36199130,12cyclictest0-21swapper/010:56:370
273192130,2sleep00-21swapper/011:40:530
77452120,2sleep07581-21copy10:10:020
36799129,2cyclictest8106-21kworker/u8:109:56:043
36799129,2cyclictest7384-21kworker/u8:212:02:053
36799129,2cyclictest28868-21kworker/u8:108:18:043
36799129,2cyclictest25746-21kworker/u8:112:39:043
36799129,2cyclictest15364-21kworker/u8:109:09:043
36799129,2cyclictest13078-21kworker/u8:107:54:013
36799129,2cyclictest1264-21kworker/u8:107:28:013
36799129,2cyclictest10811-21kworker/u8:209:30:043
36799129,2cyclictest10811-21kworker/u8:209:30:043
36799129,2cyclictest0-21swapper/310:40:163
36799129,2cyclictest0-21swapper/308:55:173
36799129,2cyclictest0-21swapper/308:20:173
36799129,2cyclictest0-21swapper/308:11:013
36799122,7cyclictest5699-21ssh10:07:013
36799122,7cyclictest0-21swapper/309:02:583
36799122,5cyclictest0-21swapper/309:20:013
36799120,2cyclictest0-21swapper/312:15:273
36799120,11cyclictest0-21swapper/308:05:493
36599120,2cyclictest0-21swapper/207:35:202
36599120,11cyclictest0-21swapper/209:30:292
36599120,11cyclictest0-21swapper/209:30:282
36599120,11cyclictest0-21swapper/208:10:132
36199129,2cyclictest101ktimersoftd/011:55:140
36199129,2cyclictest0-21swapper/011:20:090
36199129,2cyclictest0-21swapper/008:40:180
36199129,2cyclictest0-21swapper/007:30:150
36199122,7cyclictest0-21swapper/007:23:580
36199122,5cyclictest16438-21copy11:30:010
36199121,6cyclictest0-21swapper/008:20:000
36199120,2cyclictest0-21swapper/010:40:280
36199120,11cyclictest0-21swapper/012:35:410
36199120,11cyclictest0-21swapper/009:45:300
36199120,11cyclictest0-21swapper/009:25:210
36199120,11cyclictest0-21swapper/009:05:010
36199120,11cyclictest0-21swapper/008:46:050
36199120,11cyclictest0-21swapper/008:30:180
36199120,11cyclictest0-21swapper/008:20:160
36799118,2cyclictest20742-21kworker/u8:008:31:043
36799118,2cyclictest20742-21kworker/u8:008:26:043
36799118,2cyclictest18694-21kworker/u8:208:04:043
36799118,2cyclictest1264-21kworker/u8:107:19:043
36799118,2cyclictest10063-21kworker/u8:007:38:043
36799118,2cyclictest0-21swapper/311:12:123
36799118,2cyclictest0-21swapper/307:55:133
36799112,6cyclictest4562-21gdm-simple-gree08:41:583
36799112,6cyclictest0-21swapper/307:47:583
36799110,2cyclictest9034-21ssh11:20:483
36599110,2cyclictest0-21swapper/207:16:042
36199118,2cyclictest0-21swapper/009:00:180
36199118,2cyclictest0-21swapper/007:40:330
36199111,6cyclictest0-21swapper/008:05:010
191862110,2sleep00-21swapper/007:55:020
129762110,2sleep30-21swapper/307:40:103
36799100,2cyclictest4987-21ssh12:26:433
3619994,3cyclictest2988-21aten2.4_r3power08:35:130
3619981,3cyclictest11352-21diskstats07:35:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional