You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 14:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 11, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21112211995,19sleep00-21swapper/007:09:190
210612117106,6sleep10-21swapper/107:08:391
21078210898,6sleep30-21swapper/307:08:543
20944210291,6sleep20-21swapper/207:07:092
240462770,1sleep0101ktimersoftd/008:35:150
117402750,1sleep10-21swapper/109:50:061
95852250,0sleep1221ktimersoftd/109:47:021
287032250,1sleep229-21rcuc/212:20:432
247142250,1sleep00-21swapper/007:15:280
224852250,0sleep30-21swapper/310:00:183
21199992318,3cyclictest5157-21diskmemload10:15:113
2119899220,17cyclictest0-21swapper/211:07:042
2119799223,2cyclictest25282-21runrttasks10:04:041
21197992219,2cyclictest14275-21kworker/u8:209:19:041
2119799220,6cyclictest0-21swapper/108:33:041
2119999210,19cyclictest0-21swapper/307:20:113
21197992118,2cyclictest7355-21kworker/u8:110:19:041
21197992118,2cyclictest11831-21kworker/u8:210:23:051
21197992118,2cyclictest1071-21kworker/u8:112:04:051
14542210,0sleep20-21swapper/209:39:372
2119899200,2cyclictest0-21swapper/208:30:112
21197992017,2cyclictest812-21kworker/u8:309:05:051
21197992017,2cyclictest30968-21kworker/u8:007:33:041
21197992017,2cyclictest28531-21kworker/u8:012:14:041
21197992017,2cyclictest28531-21kworker/u8:011:51:041
21197992017,2cyclictest20116-21kworker/u8:109:33:051
21197992017,2cyclictest13588-21kworker/u8:208:20:011
2119799200,18cyclictest0-21swapper/111:09:041
2119699201,17cyclictest0-21swapper/008:40:140
2119899192,2cyclictest0-21swapper/211:56:052
21198991916,2cyclictest3404-21kworker/u8:009:29:042
21198991916,2cyclictest20116-21kworker/u8:109:32:052
21198991916,2cyclictest20103-21kworker/u8:110:12:042
21198991916,2cyclictest1071-21kworker/u8:112:00:052
21198991915,2cyclictest28531-21kworker/u8:011:49:052
2119899190,2cyclictest0-21swapper/210:34:042
2119899190,2cyclictest0-21swapper/209:13:042
2119899190,2cyclictest0-21swapper/208:59:042
2119899190,18cyclictest0-21swapper/210:48:052
2119899190,12cyclictest0-21swapper/211:17:042
21197991916,2cyclictest7355-21kworker/u8:110:28:041
21197991916,2cyclictest453-21kworker/u8:207:37:041
21197991916,2cyclictest30968-21kworker/u8:007:51:051
21197991916,2cyclictest27734-21kworker/u8:208:51:041
21197991916,2cyclictest19249-21kworker/u8:112:20:041
21197991916,2cyclictest10984-21kworker/u8:108:09:041
21197991916,2cyclictest10984-21kworker/u8:108:03:041
2119799190,2cyclictest0-21swapper/111:20:051
2119799190,14cyclictest0-21swapper/110:10:041
21198991815,2cyclictest7355-21kworker/u8:111:10:042
21198991815,2cyclictest26889-21kworker/u8:212:36:052
2119899180,2cyclictest0-21swapper/212:28:052
2119899180,2cyclictest0-21swapper/211:34:042
2119899180,2cyclictest0-21swapper/210:40:042
2119899180,2cyclictest0-21swapper/207:39:042
2119899180,17cyclictest0-21swapper/210:36:012
21197991815,2cyclictest7355-21kworker/u8:111:04:041
21197991815,2cyclictest4757-21kworker/u8:009:57:051
21197991815,2cyclictest30968-21kworker/u8:008:11:041
21197991815,2cyclictest30968-21kworker/u8:007:41:051
21197991815,2cyclictest26889-21kworker/u8:212:26:021
21197991815,2cyclictest23699-21kworker/u8:008:36:041
21197991815,2cyclictest19249-21kworker/u8:112:19:041
21197991815,2cyclictest15300-21kworker/u8:111:45:041
21197991815,2cyclictest14275-21kworker/u8:209:20:041
2119799180,16cyclictest0-21swapper/112:33:041
2119799180,13cyclictest0-21swapper/111:42:041
2119699182,14cyclictest17683-21aten2.4-expect08:20:110
21198991714,2cyclictest7808-21kworker/u8:212:10:052
21198991714,2cyclictest31687-21kworker/u8:312:31:042
21198991714,2cyclictest21571-21kworker/u8:007:17:042
2119899170,16cyclictest0-21swapper/208:47:042
21197991714,2cyclictest7355-21kworker/u8:110:52:041
21197991714,2cyclictest453-21kworker/u8:207:29:051
21197991714,2cyclictest23699-21kworker/u8:008:45:041
21197991714,2cyclictest21571-21kworker/u8:007:11:041
21197991714,2cyclictest21571-21kworker/u8:007:11:041
21197991714,2cyclictest19091-21kworker/u8:108:28:041
21197991714,2cyclictest13545-21kworker/u8:010:59:041
21197991714,2cyclictest1071-21kworker/u8:111:56:011
2119799170,2cyclictest0-21swapper/109:10:041
2119799170,12cyclictest0-21swapper/110:06:041
2119699179,6cyclictest31076-21ssh10:43:310
21198991613,2cyclictest7808-21kworker/u8:212:09:042
21198991613,2cyclictest30968-21kworker/u8:007:31:042
21198991613,2cyclictest15300-21kworker/u8:111:39:042
21198991613,2cyclictest10984-21kworker/u8:108:02:042
2119899160,2cyclictest0-21swapper/210:04:042
21197991613,2cyclictest7355-21kworker/u8:110:32:011
21197991613,2cyclictest30968-21kworker/u8:007:48:041
21197991613,2cyclictest23699-21kworker/u8:008:41:051
21197991613,2cyclictest13588-21kworker/u8:208:18:061
2119799160,2cyclictest5129-21runrttasks09:40:041
2119799160,2cyclictest0-21swapper/111:37:051
2119699161,3cyclictest0-21swapper/012:20:000
2119999151,3cyclictest5961-21ssh12:30:423
2119999151,3cyclictest5071-21ssh11:56:343
2119999151,3cyclictest29294-21ssh10:07:533
21199991512,2cyclictest0-21swapper/311:38:173
2119999151,12cyclictest17303-21munin-node3
2119999151,12cyclictest15346-21munin-run08:15:003
21199991510,3cyclictest0-21swapper/307:49:233
2119999150,13cyclictest7958-21sh10:52:453
2119999150,13cyclictest0-21swapper/310:21:373
21198991512,2cyclictest31385-21kworker/u8:211:27:042
21198991512,2cyclictest31385-21kworker/u8:211:22:022
21198991512,2cyclictest30968-21kworker/u8:007:57:042
21198991512,2cyclictest20116-21kworker/u8:109:41:052
21198991512,2cyclictest11831-21kworker/u8:210:29:042
21198991512,2cyclictest11831-21kworker/u8:210:09:052
2119899150,2cyclictest0-21swapper/207:52:022
21197991512,2cyclictest812-21kworker/u8:309:03:041
21197991512,2cyclictest7355-21kworker/u8:111:25:041
21197991512,2cyclictest7355-21kworker/u8:110:42:011
21197991512,2cyclictest21571-21kworker/u8:007:19:051
21197991512,2cyclictest0-21swapper/112:35:161
2119799150,2cyclictest0-21swapper/112:08:041
2119799150,2cyclictest0-21swapper/110:36:051
2119799150,10cyclictest0-21swapper/111:33:041
2119699151,12cyclictest13079-21tune2fs12:05:160
2119699151,12cyclictest12459-21ssh09:50:150
21196991510,3cyclictest23821-21ssh10:35:220
21196991510,3cyclictest12274-21latency_hist12:05:010
2119699150,13cyclictest0-21swapper/011:33:510
2119999149,3cyclictest16247-21munin-node3
2119999142,7cyclictest31309-21apt-get07:35:003
21199991411,2cyclictest0-21swapper/311:27:173
21199991411,2cyclictest0-21swapper/311:17:273
21199991411,2cyclictest0-21swapper/309:31:273
2119999140,3cyclictest0-21swapper/311:32:123
2119999140,2cyclictest5157-21diskmemload12:04:373
2119999140,2cyclictest0-21swapper/310:25:473
2119999140,13cyclictest0-21swapper/311:48:183
2119999140,12cyclictest26684-21ssh11:12:013
2119999140,12cyclictest21405-21ssh12:14:233
2119999140,12cyclictest12478-21taskset12:05:083
2119999140,12cyclictest0-21swapper/312:20:403
2119999140,12cyclictest0-21swapper/311:42:583
2119999140,12cyclictest0-21swapper/311:05:163
2119999140,12cyclictest0-21swapper/310:45:303
2119999140,12cyclictest0-21swapper/310:41:593
2119999140,12cyclictest0-21swapper/309:50:273
2119999140,12cyclictest0-21swapper/309:25:123
2119999140,12cyclictest0-21swapper/309:16:423
21198991411,2cyclictest4757-21kworker/u8:009:58:052
21198991411,2cyclictest4757-21kworker/u8:009:46:052
21198991411,2cyclictest23699-21kworker/u8:008:42:052
21198991411,2cyclictest23699-21kworker/u8:008:39:042
21198991411,2cyclictest21571-21kworker/u8:007:20:042
21198991411,2cyclictest21571-21kworker/u8:007:12:042
21198991411,2cyclictest21571-21kworker/u8:007:12:042
21198991411,2cyclictest1706-21kworker/u8:010:16:042
21198991411,2cyclictest13588-21kworker/u8:208:18:022
21198991411,2cyclictest13545-21kworker/u8:011:00:042
21198991411,2cyclictest1071-21kworker/u8:111:53:042
21198991411,2cyclictest0-21swapper/210:20:402
21198991411,2cyclictest0-21swapper/209:15:172
2119899140,12cyclictest10746-21processes10:55:192
2119899140,12cyclictest0-21swapper/209:51:352
2119899140,12cyclictest0-21swapper/209:20:322
2119799140,2cyclictest0-21swapper/111:14:051
2119799140,13cyclictest0-21swapper/109:28:051
2119699149,3cyclictest0-21swapper/012:36:050
2119699149,3cyclictest0-21swapper/009:20:510
21196991411,2cyclictest0-21swapper/012:31:010
2119699141,11cyclictest5157-21diskmemload09:41:410
2119699141,11cyclictest11-21rcuc/012:10:010
2119699140,3cyclictest27842-21aten2.4_r3power08:45:140
2119699140,2cyclictest5157-21diskmemload09:38:110
2119699140,12cyclictest24036-21sh09:29:110
2119699140,12cyclictest0-21swapper/010:17:130
70852130,2sleep00-21swapper/011:59:330
21199991310,2cyclictest0-21swapper/311:20:303
21199991310,2cyclictest0-21swapper/310:35:233
21199991310,2cyclictest0-21swapper/309:48:073
21199991310,2cyclictest0-21swapper/309:42:563
21199991310,2cyclictest0-21swapper/309:00:263
2119999130,2cyclictest5157-21diskmemload09:12:073
2119999130,2cyclictest0-21swapper/310:31:073
2119999130,2cyclictest0-21swapper/308:45:133
2119999130,2cyclictest0-21swapper/307:15:273
2119999130,12cyclictest0-21swapper/312:25:173
2119999130,12cyclictest0-21swapper/311:00:213
2119999130,12cyclictest0-21swapper/310:10:123
2119999130,12cyclictest0-21swapper/309:36:333
2119999130,12cyclictest0-21swapper/309:21:003
2119999130,12cyclictest0-21swapper/308:40:253
2119999130,11cyclictest23803-21ssh12:15:323
21198991310,2cyclictest19091-21kworker/u8:108:21:042
21198991310,2cyclictest0-21swapper/212:17:392
21198991310,2cyclictest0-21swapper/211:43:192
21198991310,2cyclictest0-21swapper/210:50:132
2119899130,2cyclictest0-21swapper/209:00:042
2119799132,8cyclictest0-21swapper/107:57:581
21197991310,2cyclictest26165-21kworker/u8:011:15:041
2119799130,12cyclictest0-21swapper/109:35:111
2119699138,3cyclictest19890-21sh11:39:070
2119699132,6cyclictest0-21swapper/009:20:000
2119699131,11cyclictest11-21rcuc/011:41:070
21196991310,2cyclictest9-21ksoftirqd/009:00:110
21196991310,2cyclictest11-21rcuc/011:16:220
21196991310,2cyclictest0-21swapper/010:30:210
21196991310,2cyclictest0-21swapper/009:56:040
21196991310,2cyclictest0-21swapper/008:55:250
21196991310,2cyclictest0-21swapper/007:25:240
2119699130,3cyclictest16273-21ssh10:27:530
2119699130,12cyclictest0-21swapper/010:05:140
2119699130,11cyclictest0-21swapper/011:28:500
2119699130,11cyclictest0-21swapper/010:47:440
89962120,2sleep00-21swapper/009:13:220
80672120,2sleep00-21swapper/010:52:550
2119999129,2cyclictest0-21swapper/311:54:283
2119999120,11cyclictest0-21swapper/312:35:333
2119999120,11cyclictest0-21swapper/310:55:363
2119999120,11cyclictest0-21swapper/309:05:123
2119999120,11cyclictest0-21swapper/308:20:233
2119999120,11cyclictest0-21swapper/307:55:203
2119999120,11cyclictest0-21swapper/307:50:193
2119999120,11cyclictest0-21swapper/307:40:153
2119899129,2cyclictest453-21kworker/u8:207:40:042
2119899129,2cyclictest27734-21kworker/u8:208:53:052
2119899129,2cyclictest0-21swapper/208:10:152
2119899122,7cyclictest0-21swapper/207:27:592
2119899120,11cyclictest0-21swapper/207:45:182
2119799120,11cyclictest0-21swapper/110:45:581
2119699129,2cyclictest0-21swapper/012:26:360
2119699129,2cyclictest0-21swapper/011:49:100
2119699129,2cyclictest0-21swapper/011:05:130
2119699129,2cyclictest0-21swapper/011:02:470
2119699129,2cyclictest0-21swapper/010:58:170
2119699129,2cyclictest0-21swapper/010:23:140
2119699127,3cyclictest1594-21sh11:53:430
2119699122,7cyclictest0-21swapper/007:32:010
2119699122,7cyclictest0-21swapper/007:10:590
2119699122,7cyclictest0-21swapper/007:10:580
2119699120,2cyclictest0-21swapper/009:46:220
2119699120,2cyclictest0-21swapper/008:00:150
2119699120,11cyclictest0-21swapper/012:21:310
2119699120,11cyclictest0-21swapper/010:00:170
2119699120,11cyclictest0-21swapper/008:30:170
2119699120,10cyclictest28823-21sh09:34:080
2119699120,10cyclictest278-21jbd2/sda1-811:10:230
2119999110,9cyclictest0-21swapper/308:05:013
2119899118,2cyclictest3404-21kworker/u8:009:07:052
2119899112,6cyclictest0-21swapper/208:07:582
2119799110,9cyclictest0-21swapper/107:20:111
2119699118,2cyclictest0-21swapper/011:20:080
2119699118,2cyclictest0-21swapper/010:13:010
2119699110,10cyclictest0-21swapper/007:45:180
2119999107,2cyclictest0-21swapper/308:50:163
2119999107,2cyclictest0-21swapper/307:10:223
2119999107,2cyclictest0-21swapper/307:10:223
2119999105,3cyclictest5083-21sshd08:57:233
2119999105,3cyclictest23608-21grep08:35:003
2119999105,3cyclictest19913-21cut08:25:153
2119999102,6cyclictest0-21swapper/307:35:253
2119899100,7cyclictest0-21swapper/208:27:022
2119699107,2cyclictest0-21swapper/007:40:230
2119699104,4cyclictest20200-21tr08:25:160
2119699102,6cyclictest0-21swapper/009:05:250
2119699102,6cyclictest0-21swapper/008:53:090
2119699102,6cyclictest0-21swapper/007:50:240
2119699100,7cyclictest0-21swapper/007:39:580
211999996,2cyclictest0-21swapper/308:35:173
211999994,3cyclictest28345-21ntp_offset07:25:183
211999991,6cyclictest0-21swapper/308:05:113
211979996,2cyclictest0-21swapper/108:55:271
211969994,3cyclictest11588-21aten2.4_r3power08:05:110
211969993,2cyclictest0-21swapper/008:12:440
211969991,3cyclictest8594-21mailstats07:55:250
211969990,7cyclictest0-21swapper/008:15:070
211969980,6cyclictest0-21swapper/007:20:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional