You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 13:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Tue Jul 28, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14862210897,6sleep20-21swapper/207:05:452
14886210786,15sleep30-21swapper/307:05:583
15530210594,6sleep00-21swapper/007:09:120
15457210280,16sleep10-21swapper/107:08:161
187902810,2sleep318793-21proc_pri07:15:193
167422760,0sleep00-21swapper/012:12:440
167422760,0sleep00-21swapper/012:12:430
180142690,0sleep00-21swapper/008:35:010
270792670,0sleep00-21swapper/010:44:130
224552270,1sleep30-21swapper/310:39:353
37692240,0sleep10-21swapper/110:53:121
1562199245,17cyclictest15140-21ssh11:05:122
224342220,0sleep00-21swapper/010:05:210
15621992218,2cyclictest0-21swapper/209:30:112
15619992217,3cyclictest13839-21kworker/u8:311:52:050
15622992118,2cyclictest9253-21kworker/u8:009:54:053
15622992017,2cyclictest30567-21kworker/u8:110:59:053
1562199201,17cyclictest0-21swapper/210:35:122
1562199200,3cyclictest8446-21cut08:10:142
1562199200,3cyclictest6124-21diskstats12:35:142
1562199200,3cyclictest29703-21diskmemload10:13:262
1562199200,3cyclictest25424-21munin-node2
1562199200,3cyclictest22406-21perl07:25:152
1562199200,3cyclictest0-21swapper/212:18:312
1562199200,3cyclictest0-21swapper/212:18:302
1562199200,3cyclictest0-21swapper/211:27:582
1562199200,3cyclictest0-21swapper/209:10:142
15619992017,2cyclictest27711-21kworker/u8:009:39:040
140362200,0sleep30-21swapper/312:10:153
140362200,0sleep30-21swapper/312:10:143
15622991916,2cyclictest4816-21kworker/u8:109:24:043
15622991916,2cyclictest31535-21kworker/u8:012:04:023
15622991916,2cyclictest22865-21kworker/u8:010:10:043
15622991916,2cyclictest17086-21kworker/u8:309:44:053
15621991911,6cyclictest0-21swapper/211:00:152
1562199190,3cyclictest9104-21rm09:51:462
1562199190,3cyclictest7624-21ssh10:24:112
1562199190,3cyclictest32562-21entropy07:50:152
1562199190,3cyclictest29917-21ssh12:26:032
1562199190,3cyclictest0-21swapper/211:49:552
1562199190,3cyclictest0-21swapper/211:11:212
1562199190,3cyclictest0-21swapper/210:46:112
1562199190,17cyclictest0-21swapper/211:30:112
1562199190,13cyclictest0-21swapper/207:40:132
1562099190,2cyclictest27601-21apt-get10:45:051
268252180,0sleep30-21swapper/311:16:063
15622991815,2cyclictest31535-21kworker/u8:011:57:043
15622991815,2cyclictest31122-21kworker/u8:210:27:043
15622991815,2cyclictest17086-21kworker/u8:309:18:063
1562199180,3cyclictest17088-21ssh09:26:462
1562199180,3cyclictest159632sleep211:39:112
1562199180,3cyclictest13654-21diskmemload09:23:582
1562199180,12cyclictest8695-21ssh09:18:512
15620991815,2cyclictest1688-21kworker/u8:109:48:051
15619991815,2cyclictest17086-21kworker/u8:309:45:050
252932170,0sleep30-21swapper/310:41:273
15622991714,2cyclictest9580-21kworker/u8:111:35:053
15622991714,2cyclictest31122-21kworker/u8:210:18:013
15622991714,2cyclictest17086-21kworker/u8:309:59:053
15622991714,2cyclictest17086-21kworker/u8:308:45:043
15622991714,2cyclictest10410-21kworker/u8:011:23:053
1562299170,2cyclictest31974-21diskmemload09:48:043
1562199174,11cyclictest0-21swapper/207:15:142
1562199173,4cyclictest4295-21sh12:00:142
1562199170,15cyclictest0-21swapper/211:51:482
15620991714,2cyclictest13485-21kworker/u8:010:36:051
15619991714,2cyclictest3450-21kworker/u8:012:33:050
15619991714,2cyclictest30567-21kworker/u8:110:58:040
15619991714,2cyclictest22865-21kworker/u8:010:21:050
1562299161,3cyclictest31610-21munin-node3
15622991613,2cyclictest31931-21kworker/u8:007:59:043
15622991613,2cyclictest20911-21kworker/u8:112:35:043
15622991613,2cyclictest20911-21kworker/u8:112:25:053
15622991613,2cyclictest20911-21kworker/u8:112:24:043
15622991613,2cyclictest20911-21kworker/u8:111:45:053
15622991613,2cyclictest13839-21kworker/u8:311:53:043
15622991613,2cyclictest10410-21kworker/u8:011:14:053
1562299161,2cyclictest0-21swapper/310:45:053
1562199169,5cyclictest0-21swapper/212:10:542
1562199169,5cyclictest0-21swapper/212:10:532
1562199164,3cyclictest31974-21diskmemload09:41:092
1562199164,3cyclictest26323-21sendmail-mta10:43:232
1562199162,6cyclictest0-21swapper/209:06:032
1562199161,3cyclictest0-21swapper/212:30:112
1562199161,3cyclictest0-21swapper/209:45:122
1562199160,15cyclictest0-21swapper/211:40:132
1562199160,14cyclictest30262-21grep11:20:142
1562199160,14cyclictest0-21swapper/212:21:242
1562199160,10cyclictest0-21swapper/210:09:202
1562099160,2cyclictest0-21swapper/108:16:051
15619991613,2cyclictest4816-21kworker/u8:109:22:060
1561999160,2cyclictest0-21swapper/010:45:040
15622991512,2cyclictest3704-21kworker/u8:211:28:053
15622991512,2cyclictest31703-21kworker/u8:009:14:043
15622991512,2cyclictest29165-21kworker/u8:207:41:043
15622991512,2cyclictest20911-21kworker/u8:112:15:053
15622991512,2cyclictest20911-21kworker/u8:112:15:043
15622991512,2cyclictest19972-21kworker/u8:107:28:053
15622991512,2cyclictest17086-21kworker/u8:309:30:053
15622991512,2cyclictest13485-21kworker/u8:010:33:053
15622991512,2cyclictest10998-21kworker/u8:108:25:053
15622991512,2cyclictest0-21swapper/311:40:213
15622991512,2cyclictest0-21swapper/310:51:213
1562299151,12cyclictest7056-21ssh11:30:063
1562299151,12cyclictest24395-21apt-get09:35:133
1562299151,12cyclictest22689-21ssh10:05:433
1562299150,2cyclictest0-21swapper/311:00:113
1562299150,13cyclictest0-21swapper/311:07:013
1562199154,3cyclictest31974-21diskmemload11:55:072
1562199154,3cyclictest24905-21fschecks_time09:35:162
1562199153,3cyclictest31088-21sh10:15:122
1562199153,3cyclictest260632sleep207:35:122
1562199151,4cyclictest6080-21aten2.4_r3power08:05:132
1562199151,4cyclictest16092-21cpuspeed_turbos07:10:122
1562199151,4cyclictest11407-21grep08:16:062
1562199151,3cyclictest450-21stty10:50:122
1562199151,3cyclictest29967-21munin-run09:05:002
1562199151,3cyclictest20247-21head08:40:142
1562199151,3cyclictest10739-21grep12:06:042
1562199151,3cyclictest0-21swapper/210:55:132
1562199151,3cyclictest0-21swapper/210:30:152
1562199151,3cyclictest0-21swapper/210:25:112
1562199151,3cyclictest0-21swapper/210:01:032
1562199151,3cyclictest0-21swapper/209:55:022
1562199151,3cyclictest0-21swapper/208:55:132
1562199151,3cyclictest0-21swapper/208:50:122
1562199151,3cyclictest0-21swapper/208:45:132
1562199151,3cyclictest0-21swapper/208:30:142
1562199151,3cyclictest0-21swapper/208:25:042
1562199151,3cyclictest0-21swapper/208:20:102
1562199151,3cyclictest0-21swapper/208:01:002
1562199151,3cyclictest0-21swapper/208:00:002
1562199151,3cyclictest0-21swapper/207:30:142
1562199151,3cyclictest0-21swapper/207:20:142
1562099150,13cyclictest3841-21aten2.4-expect08:00:111
15619991512,2cyclictest17086-21kworker/u8:308:41:040
15619991512,2cyclictest16437-21kworker/u8:110:15:040
15619991512,2cyclictest10410-21kworker/u8:011:42:040
15619991512,2cyclictest10410-21kworker/u8:011:22:040
15619991510,3cyclictest0-21swapper/011:30:130
1561999150,2cyclictest31974-21diskmemload10:36:050
1561999150,2cyclictest31974-21diskmemload10:00:040
1561999150,13cyclictest0-21swapper/011:45:130
1561999150,13cyclictest0-21swapper/007:45:160
1561999150,10cyclictest0-21swapper/009:10:010
46172141,2sleep30-21swapper/312:33:523
15622991411,2cyclictest6887-21kworker/u8:110:24:053
15622991411,2cyclictest17086-21kworker/u8:308:36:043
1562299140,3cyclictest20891-21ssh10:04:513
1562299140,2cyclictest0-21swapper/312:07:213
1562199141,3cyclictest0-21swapper/208:35:082
1562199141,3cyclictest0-21swapper/207:45:022
1562099144,8cyclictest0-21swapper/110:01:011
15620991411,2cyclictest4816-21kworker/u8:109:36:041
15620991411,2cyclictest3704-21kworker/u8:211:28:021
15620991411,2cyclictest0-21swapper/112:25:131
1562099140,2cyclictest0-21swapper/110:44:041
1562099140,12cyclictest15795-21if_err_eth011:05:161
1562099140,12cyclictest0-21swapper/112:05:051
1562099140,12cyclictest0-21swapper/112:00:181
1562099140,12cyclictest0-21swapper/111:53:201
1562099140,12cyclictest0-21swapper/111:03:271
1562099140,12cyclictest0-21swapper/110:25:381
1562099140,12cyclictest0-21swapper/109:10:511
15619991411,2cyclictest24238-21kworker/u8:211:02:060
15619991411,2cyclictest0-21swapper/009:50:290
15619991410,2cyclictest0-21swapper/007:10:150
1561999140,12cyclictest0-21swapper/011:26:280
1561999140,12cyclictest0-21swapper/009:27:130
140622140,2sleep10-21swapper/109:56:541
76232130,2sleep00-21swapper/012:03:430
34022130,2sleep10-21swapper/111:59:551
219872130,2sleep00-21swapper/011:11:080
15622991310,2cyclictest17467-21kworker/u8:207:34:043
15622991310,2cyclictest0-21swapper/308:00:153
1562299130,2cyclictest11154-21wc08:16:053
1562299130,12cyclictest0-21swapper/309:25:183
1562299130,12cyclictest0-21swapper/307:35:183
15620991310,2cyclictest31974-21diskmemload12:13:211
15620991310,2cyclictest31974-21diskmemload12:13:201
15620991310,2cyclictest31122-21kworker/u8:210:19:041
15620991310,2cyclictest14647-21apt-get09:25:121
15620991310,2cyclictest0-21swapper/111:15:161
15620991310,2cyclictest0-21swapper/109:00:181
15620991310,2cyclictest0-21swapper/107:11:011
1562099130,2cyclictest19617-21aten2.4-expect09:30:121
1562099130,2cyclictest0-21swapper/107:55:121
1562099130,11cyclictest16612-21sendmail-mta10:33:031
1562099130,11cyclictest0-21swapper/110:10:051
1562099130,11cyclictest0-21swapper/108:35:281
1562099130,11cyclictest0-21swapper/107:25:401
1561999132,7cyclictest25616-21runrttasks07:33:590
15619991310,2cyclictest31931-21kworker/u8:008:06:050
15619991310,2cyclictest31122-21kworker/u8:210:30:040
15619991310,2cyclictest17543-21kworker/u8:111:08:050
15619991310,2cyclictest13839-21kworker/u8:311:38:060
15619991310,2cyclictest10410-21kworker/u8:011:16:050
15619991310,2cyclictest0-21swapper/008:56:040
1561999130,8cyclictest0-21swapper/012:05:040
1561999130,8cyclictest0-21swapper/008:21:050
1561999130,2cyclictest0-21swapper/008:16:040
1561999130,12cyclictest0-21swapper/012:27:490
1561999130,12cyclictest0-21swapper/010:13:270
1561999130,12cyclictest0-21swapper/009:57:400
1561999130,11cyclictest0-21swapper/010:26:050
1562299129,2cyclictest17467-21kworker/u8:207:21:043
1562299129,2cyclictest13586-21kworker/u8:107:12:023
1562299129,2cyclictest0-21swapper/308:20:043
1562299120,2cyclictest0-21swapper/308:54:133
1562099129,2cyclictest31703-21kworker/u8:009:07:051
1562099129,2cyclictest28444-21kworker/u8:212:31:051
1562099129,2cyclictest21036-21copy10:05:041
1562099129,2cyclictest1874-21kworker/u8:108:05:051
1562099129,2cyclictest0-21swapper/109:41:031
1562099120,2cyclictest8215-21sh11:30:221
1562099120,2cyclictest770-21cut07:50:511
1562099120,2cyclictest0-21swapper/112:36:201
1562099120,2cyclictest0-21swapper/111:41:391
1562099120,2cyclictest0-21swapper/110:20:301
1562099120,2cyclictest0-21swapper/107:36:031
1562099120,11cyclictest31974-21diskmemload09:16:021
1562099120,11cyclictest0-21swapper/111:48:341
1562099120,11cyclictest0-21swapper/111:10:381
1562099120,11cyclictest0-21swapper/110:55:141
1562099120,11cyclictest0-21swapper/108:30:191
1562099120,11cyclictest0-21swapper/107:31:031
1562099120,10cyclictest0-21swapper/109:50:121
1562099120,10cyclictest0-21swapper/108:46:041
1562099120,10cyclictest0-21swapper/107:15:511
1561999129,2cyclictest29165-21kworker/u8:207:52:040
1561999129,2cyclictest20931-21kworker/u8:012:20:040
1561999129,2cyclictest17086-21kworker/u8:308:50:040
1561999129,2cyclictest0-21swapper/009:41:000
1561999129,2cyclictest0-21swapper/009:30:140
1561999122,7cyclictest0-21swapper/008:49:590
1561999120,2cyclictest0-21swapper/012:15:370
1561999120,2cyclictest0-21swapper/012:15:360
1561999120,2cyclictest0-21swapper/011:55:120
1561999120,2cyclictest0-21swapper/010:52:050
1561999120,2cyclictest0-21swapper/009:15:170
1561999120,2cyclictest0-21swapper/009:00:150
1561999120,2cyclictest0-21swapper/007:55:140
1561999120,2cyclictest0-21swapper/007:15:510
1561999120,11cyclictest0-21swapper/012:35:180
1561999120,11cyclictest0-21swapper/009:06:020
1561999120,11cyclictest0-21swapper/007:25:170
1562299118,2cyclictest31931-21kworker/u8:008:10:013
1562299118,2cyclictest29165-21kworker/u8:207:50:053
1562299118,2cyclictest26244-21kworker/u8:109:00:043
1562299118,2cyclictest0-21swapper/308:56:013
1562299110,2cyclictest0-21swapper/308:05:043
1562299110,10cyclictest0-21swapper/308:43:223
1562099118,2cyclictest0-21swapper/112:15:301
1562099118,2cyclictest0-21swapper/112:15:291
1562099112,2cyclictest0-21swapper/108:10:131
1562099110,9cyclictest9800-21apt-get09:20:121
1562099110,9cyclictest24787-21if_eth008:50:151
1562099110,9cyclictest0-21swapper/108:40:161
1562099110,9cyclictest0-21swapper/108:25:131
1562099110,9cyclictest0-21swapper/108:20:061
1562099110,9cyclictest0-21swapper/107:40:111
1562099110,2cyclictest0-21swapper/111:21:061
1562099110,10cyclictest0-21swapper/112:20:381
1561999118,2cyclictest26030-21kworker/u8:107:40:050
1561999118,2cyclictest17086-21kworker/u8:308:39:040
1561999110,3cyclictest0-21swapper/007:35:190
170422100,2sleep30-21swapper/308:30:193
1562099107,2cyclictest29165-21kworker/u8:207:49:041
1562099100,2cyclictest26653-21fschecks_time08:55:151
1562099100,2cyclictest0-21swapper/111:35:051
1561999107,2cyclictest0-21swapper/008:10:160
1561999105,3cyclictest4016-21cpu08:00:120
1561999102,6cyclictest19978-21aten2.4_r3power07:20:120
1561999100,9cyclictest0-21swapper/008:27:370
156209990,8cyclictest0-21swapper/107:20:141
156229981,5cyclictest30856-21iostat_ios09:05:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional