You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 20:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Fri Nov 21, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21504211896,16sleep30-21swapper/307:07:053
217192117106,6sleep10-21swapper/107:09:481
21731211392,15sleep20-21swapper/207:09:562
21589211190,16sleep00-21swapper/007:08:110
227442800,0sleep10-21swapper/111:43:351
222862770,1sleep222294-21aten2.4_r3power08:30:132
222862770,1sleep222294-21aten2.4_r3power08:30:122
135512750,1sleep00-21swapper/011:00:000
102282710,0sleep30-21swapper/312:38:593
11742650,0sleep10-21swapper/110:45:461
52802580,1sleep10-21swapper/110:16:041
49232250,0sleep10-21swapper/111:59:221
15582250,0sleep10-21swapper/110:12:481
247762240,1sleep0101ktimersoftd/011:45:180
21770992219,2cyclictest2342-21kworker/u8:111:18:023
21770992219,2cyclictest2342-21kworker/u8:111:18:023
21770992219,2cyclictest11187-21kworker/u8:010:00:053
21768992219,2cyclictest23620-21kworker/u8:211:45:041
21770992118,2cyclictest4339-21kworker/u8:209:48:063
21770992118,2cyclictest28387-21kworker/u8:210:13:053
21770992118,2cyclictest23465-21kworker/u8:010:54:053
21770992118,2cyclictest1935-21kworker/u8:009:25:043
21770992118,2cyclictest1935-21kworker/u8:009:21:053
21770992118,2cyclictest16278-21kworker/u8:110:09:043
21770992118,2cyclictest12926-21kworker/u8:011:38:053
21770992118,2cyclictest12926-21kworker/u8:011:34:053
21770992118,2cyclictest11592-21kworker/u8:008:22:043
21767992118,2cyclictest3267-21kworker/u8:211:58:050
2177099202,2cyclictest0-21swapper/311:45:043
21770992017,2cyclictest29293-21kworker/u8:210:45:053
21770992017,2cyclictest23465-21kworker/u8:010:58:053
21770992017,2cyclictest2342-21kworker/u8:111:00:063
21770992017,2cyclictest1935-21kworker/u8:009:43:043
21770992017,2cyclictest1935-21kworker/u8:009:12:053
21770992017,2cyclictest18804-21kworker/u8:111:54:053
21770992017,2cyclictest1787-21kworker/u8:208:12:053
21770992017,2cyclictest1787-21kworker/u8:208:00:053
21770992017,2cyclictest1787-21kworker/u8:207:58:043
21770992017,2cyclictest17760-21kworker/u8:012:13:043
21770992017,2cyclictest16278-21kworker/u8:110:18:013
21770992017,2cyclictest1492-21kworker/u8:112:33:053
21770992017,2cyclictest13601-21kworker/u8:207:12:053
21770992017,2cyclictest12763-21kworker/u8:211:10:063
21770992017,2cyclictest12763-21kworker/u8:211:10:053
21770992017,2cyclictest11187-21kworker/u8:009:56:053
21767992017,2cyclictest2342-21kworker/u8:111:06:060
21767992014,4cyclictest4324-21nscd11:25:110
21770991916,2cyclictest3439-21kworker/u8:010:26:053
21770991916,2cyclictest3439-21kworker/u8:010:20:053
21770991916,2cyclictest27608-21kworker/u8:107:28:023
21770991916,2cyclictest1935-21kworker/u8:009:01:043
21770991916,2cyclictest18804-21kworker/u8:111:56:053
21770991916,2cyclictest1787-21kworker/u8:207:46:053
21770991916,2cyclictest17760-21kworker/u8:012:20:053
21770991916,2cyclictest16278-21kworker/u8:110:37:053
21770991916,2cyclictest14915-21kworker/u8:210:34:043
21770991916,2cyclictest12763-21kworker/u8:211:08:043
21770991916,2cyclictest11789-21kworker/u8:312:06:053
21770991916,2cyclictest11592-21kworker/u8:008:36:053
21767991916,2cyclictest8251-21kworker/u8:112:04:040
21767991916,2cyclictest27608-21kworker/u8:107:30:050
127232190,0sleep00-21swapper/012:06:310
21770991815,2cyclictest30123-21kworker/u8:007:53:053
21770991815,2cyclictest29293-21kworker/u8:210:44:043
21770991815,2cyclictest27608-21kworker/u8:107:40:043
21770991815,2cyclictest27608-21kworker/u8:107:35:053
21770991815,2cyclictest1935-21kworker/u8:009:37:053
21770991815,2cyclictest17760-21kworker/u8:012:17:053
21770991815,2cyclictest13601-21kworker/u8:207:22:053
2177099180,16cyclictest0-21swapper/312:28:053
21768991815,2cyclictest8323-21kworker/u8:309:13:051
21768991815,2cyclictest13601-21kworker/u8:207:25:051
21767991815,2cyclictest30658-21kworker/u8:011:53:040
21770991714,2cyclictest30658-21kworker/u8:012:03:053
21770991714,2cyclictest1935-21kworker/u8:009:19:043
21770991714,2cyclictest1935-21kworker/u8:009:05:053
21770991714,2cyclictest1787-21kworker/u8:208:15:053
21770991714,2cyclictest1378-21kworker/u8:211:26:053
21770991714,2cyclictest11592-21kworker/u8:008:31:053
21770991714,2cyclictest11592-21kworker/u8:008:31:043
21770991714,2cyclictest11187-21kworker/u8:009:50:043
2177099170,2cyclictest0-21swapper/311:41:053
21768991714,2cyclictest7970-21kworker/u8:111:30:021
21768991714,2cyclictest28318-21kworker/u8:212:28:041
21768991714,2cyclictest27608-21kworker/u8:107:31:051
21768991714,2cyclictest2342-21kworker/u8:110:52:051
21768991714,2cyclictest16278-21kworker/u8:110:30:041
2176899170,15cyclictest23266-21munin-node1
2176899170,15cyclictest23266-21munin-node1
2176799172,9cyclictest31591-21gpgv10:45:010
21767991714,2cyclictest30123-21kworker/u8:007:42:020
21767991714,2cyclictest24342-21kworker/u8:309:31:040
21767991714,2cyclictest2342-21kworker/u8:111:13:050
21767991714,2cyclictest2342-21kworker/u8:111:13:040
21767991714,2cyclictest17760-21kworker/u8:012:24:050
21767991714,2cyclictest16278-21kworker/u8:110:14:020
21767991714,2cyclictest11187-21kworker/u8:009:55:040
21770991613,2cyclictest13601-21kworker/u8:207:17:053
21770991613,2cyclictest11592-21kworker/u8:008:25:053
2177099160,14cyclictest0-21swapper/311:20:483
21768991613,2cyclictest4339-21kworker/u8:209:48:021
21768991613,2cyclictest30123-21kworker/u8:007:44:021
21768991613,2cyclictest29293-21kworker/u8:210:42:021
21768991613,2cyclictest1787-21kworker/u8:207:56:011
21768991613,2cyclictest16278-21kworker/u8:110:28:051
21768991613,2cyclictest13601-21kworker/u8:207:19:051
21768991613,2cyclictest11592-21kworker/u8:008:32:021
21768991613,2cyclictest11592-21kworker/u8:008:32:021
21767991613,2cyclictest16278-21kworker/u8:110:23:040
21767991613,2cyclictest16278-21kworker/u8:110:15:050
21767991613,2cyclictest14915-21kworker/u8:210:33:040
2176799160,14cyclictest4009-21cat10:50:000
21770991512,2cyclictest11592-21kworker/u8:008:50:043
21770991512,2cyclictest11592-21kworker/u8:008:46:053
2177099150,14cyclictest0-21swapper/307:34:043
2176999151,12cyclictest2318-21ssh10:47:362
21769991510,3cyclictest0-21swapper/209:26:132
21768991512,2cyclictest29989-21kworker/u8:109:36:051
21768991512,2cyclictest27608-21kworker/u8:107:36:051
21768991512,2cyclictest2342-21kworker/u8:111:20:041
21768991512,2cyclictest18804-21kworker/u8:111:50:061
21768991512,2cyclictest1787-21kworker/u8:208:20:041
21768991512,2cyclictest1787-21kworker/u8:208:14:041
21768991512,2cyclictest17760-21kworker/u8:012:16:051
21768991512,2cyclictest1492-21kworker/u8:112:30:051
21768991512,2cyclictest13601-21kworker/u8:207:24:041
21768991512,2cyclictest11592-21kworker/u8:008:35:051
21768991512,2cyclictest11592-21kworker/u8:008:28:051
21768991512,2cyclictest11187-21kworker/u8:009:51:051
2176899150,13cyclictest0-21swapper/111:18:021
2176899150,13cyclictest0-21swapper/111:18:011
2176899150,11cyclictest0-21swapper/110:21:251
21767991512,2cyclictest4339-21kworker/u8:209:45:040
21767991512,2cyclictest12926-21kworker/u8:011:37:040
21767991512,2cyclictest11187-21kworker/u8:010:04:050
2176799150,3cyclictest0-21swapper/010:25:160
2176799150,13cyclictest9802-21ssh11:30:110
2176799150,10cyclictest0-21swapper/007:57:050
21770991411,2cyclictest1935-21kworker/u8:009:32:053
21770991411,2cyclictest11592-21kworker/u8:008:43:053
21770991410,2cyclictest0-21swapper/308:05:213
2176999149,3cyclictest0-21swapper/209:10:272
2176999142,6cyclictest0-21swapper/208:50:012
2176999141,7cyclictest0-21swapper/212:39:592
2176999140,3cyclictest399-21ssh12:28:372
2176999140,2cyclictest19244-21apt-get11:40:122
2176999140,12cyclictest25980-21copy10:05:012
2176999140,12cyclictest0-21swapper/210:29:012
21768991411,2cyclictest5834-21diskmemload12:00:081
21768991411,2cyclictest5834-21diskmemload09:27:321
21768991411,2cyclictest25915-21kworker/u8:208:56:051
21768991411,2cyclictest1787-21kworker/u8:208:16:021
21768991411,2cyclictest0-21swapper/111:06:021
21768991411,2cyclictest0-21swapper/110:38:021
21768991411,2cyclictest0-21swapper/109:18:461
2176899140,2cyclictest5834-21diskmemload09:32:011
2176899140,2cyclictest0-21swapper/111:35:511
2176899140,12cyclictest5834-21diskmemload10:01:401
2176899140,12cyclictest0-21swapper/112:11:131
2176899140,12cyclictest0-21swapper/110:55:261
2176899140,12cyclictest0-21swapper/109:23:051
21767991411,2cyclictest30389-21kworker/u8:108:51:050
21767991411,2cyclictest29989-21kworker/u8:109:44:050
21767991411,2cyclictest28318-21kworker/u8:212:35:040
21767991411,2cyclictest1935-21kworker/u8:009:27:050
21767991411,2cyclictest11187-21kworker/u8:009:52:050
2176799140,9cyclictest0-21swapper/007:13:040
2176799140,2cyclictest0-21swapper/010:36:050
2176799140,12cyclictest5834-21diskmemload10:05:060
2177099130,12cyclictest0-21swapper/308:55:133
2176999132,6cyclictest0-21swapper/212:00:002
2176999132,6cyclictest0-21swapper/208:00:002
21769991310,2cyclictest5834-21diskmemload12:04:122
21769991310,2cyclictest4516-21ssh10:15:242
21769991310,2cyclictest0-21swapper/211:26:052
21769991310,2cyclictest0-21swapper/211:22:022
21769991310,2cyclictest0-21swapper/211:15:562
21769991310,2cyclictest0-21swapper/211:15:552
21769991310,2cyclictest0-21swapper/210:10:252
2176999130,2cyclictest0-21swapper/211:48:162
2176999130,2cyclictest0-21swapper/209:16:422
2176999130,2cyclictest0-21swapper/208:50:232
2176999130,12cyclictest0-21swapper/211:00:172
2176999130,11cyclictest5834-21diskmemload12:32:342
2176999130,11cyclictest5834-21diskmemload10:53:352
2176999130,11cyclictest0-21swapper/209:41:152
21768991310,2cyclictest5834-21diskmemload12:20:381
21768991310,2cyclictest28387-21kworker/u8:210:07:041
21768991310,2cyclictest1787-21kworker/u8:207:47:041
21768991310,2cyclictest1492-21kworker/u8:112:37:041
21768991310,2cyclictest11592-21kworker/u8:008:47:051
21768991310,2cyclictest0-21swapper/111:01:231
2176899130,2cyclictest5834-21diskmemload12:06:121
2176899130,12cyclictest5834-21diskmemload09:57:251
2176899130,12cyclictest0-21swapper/111:29:251
2176899130,11cyclictest0-21swapper/109:40:131
2176899130,11cyclictest0-21swapper/108:00:211
2176799132,6cyclictest0-21swapper/007:45:000
21767991310,2cyclictest5834-21diskmemload12:13:410
21767991310,2cyclictest1787-21kworker/u8:207:50:050
21767991310,2cyclictest1378-21kworker/u8:211:23:050
21767991310,2cyclictest11592-21kworker/u8:008:06:050
2176799130,2cyclictest0-21swapper/010:50:190
2176799130,12cyclictest0-21swapper/012:26:010
10442130,1sleep0101ktimersoftd/007:35:250
2176999129,2cyclictest5834-21diskmemload12:10:442
2176999129,2cyclictest5834-21diskmemload10:57:442
2176999129,2cyclictest19441-21ssh09:57:142
2176999129,2cyclictest0-21swapper/212:24:522
2176999129,2cyclictest0-21swapper/212:06:002
2176999129,2cyclictest0-21swapper/211:35:032
2176999129,2cyclictest0-21swapper/211:05:142
2176999129,2cyclictest0-21swapper/210:41:042
2176999129,2cyclictest0-21swapper/210:20:152
2176999129,2cyclictest0-21swapper/210:01:002
2176999129,2cyclictest0-21swapper/209:35:232
2176999129,2cyclictest0-21swapper/209:30:052
2176999129,2cyclictest0-21swapper/208:40:122
2176999129,2cyclictest0-21swapper/207:35:152
2176999127,3cyclictest947-21sensors_temp08:55:252
2176999122,7cyclictest0-21swapper/207:28:592
2176999122,6cyclictest0-21swapper/207:50:242
2176999120,2cyclictest0-21swapper/210:30:392
2176999120,11cyclictest0-21swapper/212:15:212
2176999120,11cyclictest0-21swapper/211:50:472
2176999120,11cyclictest0-21swapper/211:30:142
2176999120,11cyclictest0-21swapper/211:10:562
2176999120,11cyclictest0-21swapper/211:10:562
2176999120,11cyclictest0-21swapper/210:37:142
2176999120,11cyclictest0-21swapper/209:50:262
2176999120,11cyclictest0-21swapper/209:45:172
2176999120,11cyclictest0-21swapper/207:20:112
2176899129,2cyclictest11592-21kworker/u8:008:44:041
2176899129,2cyclictest0-21swapper/107:10:171
2176899120,11cyclictest0-21swapper/109:05:231
2176799129,2cyclictest5834-21diskmemload09:16:110
2176799129,2cyclictest27608-21kworker/u8:107:29:050
2176799129,2cyclictest25915-21kworker/u8:208:58:040
2176799129,2cyclictest24342-21kworker/u8:309:35:050
2176799129,2cyclictest2342-21kworker/u8:111:15:050
2176799129,2cyclictest2342-21kworker/u8:111:15:040
2176799129,2cyclictest11592-21kworker/u8:008:04:050
2176799129,2cyclictest0-21swapper/012:16:590
2176799129,2cyclictest0-21swapper/011:42:210
2176799129,2cyclictest0-21swapper/011:00:320
2176799129,2cyclictest0-21swapper/009:05:270
2176799122,6cyclictest0-21swapper/008:40:010
2176799120,2cyclictest0-21swapper/012:32:110
2176799120,2cyclictest0-21swapper/009:12:000
2176799120,1cyclictest0-21swapper/009:21:400
217222120,2sleep00-21swapper/008:26:320
2176999118,2cyclictest0-21swapper/209:22:272
2176999118,2cyclictest0-21swapper/207:45:142
2176999118,2cyclictest0-21swapper/207:40:282
2176999116,3cyclictest30575-21cut07:30:122
2176999112,5cyclictest0-21swapper/208:15:012
2176899111,8cyclictest0-21swapper/108:50:111
2176799118,2cyclictest0-21swapper/008:15:190
2176799116,3cyclictest23566-21grep08:30:270
2176799116,3cyclictest23566-21grep08:30:260
2176799116,3cyclictest14432-21cpuspeed_turbos08:10:110
2176799111,6cyclictest0-21swapper/008:45:130
2176999105,3cyclictest4713-21NetworkManager07:10:042
2176999105,3cyclictest3762-21grep09:05:012
2176999105,3cyclictest25340-21grep07:15:262
2176999102,6cyclictest0-21swapper/208:00:242
2176999101,6cyclictest0-21swapper/208:35:242
2176999101,3cyclictest0-21swapper/209:09:552
2176999100,8cyclictest0-21swapper/208:09:552
2176999100,7cyclictest0-21swapper/208:15:022
2176899107,2cyclictest0-21swapper/109:00:121
2176899100,8cyclictest6100-21munin-node1
2176799107,2cyclictest0-21swapper/007:15:260
2176799105,3cyclictest2012-21aten2.4_r3power09:00:130
217699994,3cyclictest21114-21open_files08:25:182
217699993,4cyclictest18772-21tr08:20:152
217689996,2cyclictest0-21swapper/108:05:151
217679996,2cyclictest0-21swapper/008:40:140
217679995,3cyclictest27562-21sshd07:21:300
217679990,2cyclictest0-21swapper/008:22:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional