You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 15:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Dec 04, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
625921630,3sleep11287699cyclictest12:11:581
12805211797,15sleep00-21swapper/007:09:280
12753211796,16sleep20-21swapper/207:08:512
12625211497,12sleep30-21swapper/307:07:113
12608211193,12sleep10-21swapper/107:06:581
122262740,0sleep00-21swapper/012:19:060
7792730,0sleep30-21swapper/310:22:423
299902700,1sleep329993-21turbostat.cron10:20:003
60192670,0sleep20-21swapper/211:37:162
219252250,2sleep021927-21switchtime09:35:290
318572220,0sleep00-21swapper/010:55:290
1287899210,13cyclictest0-21swapper/312:05:123
12876992118,2cyclictest0-21swapper/112:00:121
12876992118,2cyclictest0-21swapper/112:00:121
12878991914,3cyclictest7011-21ssh09:55:133
12877991916,2cyclictest14173-21kworker/u8:111:22:012
12877991815,2cyclictest20617-21kworker/u8:212:37:052
153092170,0sleep10-21swapper/110:38:231
12877991714,2cyclictest8382-21kworker/u8:012:16:052
12875991714,2cyclictest18086-21kworker/u8:110:18:040
1287899161,13cyclictest0-21swapper/311:06:413
1287899161,13cyclictest0-21swapper/311:00:133
12877991613,2cyclictest21499-21kworker/u8:009:13:042
1287799161,13cyclictest11886-21gdbus10:35:052
1287699160,14cyclictest332250irq/24-eth111:44:481
12875991613,2cyclictest9203-21kworker/u8:211:07:040
49482150,0sleep00-21swapper/011:35:410
1287899152,6cyclictest0-21swapper/308:45:003
1287899152,11cyclictest0-21swapper/312:32:383
1287899151,12cyclictest21000-21df09:35:163
1287899151,11cyclictest0-21swapper/309:46:573
12878991510,3cyclictest0-21swapper/311:16:083
1287899150,13cyclictest22549-21ntp_kernel_err11:20:203
1287899150,13cyclictest0-21swapper/310:40:393
1287799151,3cyclictest0-21swapper/211:54:442
1287799151,3cyclictest0-21swapper/211:54:442
12877991512,2cyclictest28741-21kworker/u8:210:31:042
1287799151,12cyclictest675-21ssh11:31:262
1287799151,12cyclictest25192-40update-apt-xapi07:40:072
1287799150,2cyclictest0-21swapper/211:45:472
1287799150,13cyclictest9543-21ssh09:57:042
1287799150,13cyclictest0-21swapper/212:00:552
1287799150,13cyclictest0-21swapper/212:00:552
1287799150,13cyclictest0-21swapper/208:45:182
1287699150,2cyclictest0-21swapper/112:20:181
1287699150,13cyclictest0-21swapper/109:18:381
12875991512,2cyclictest16909-21kworker/u8:211:50:060
12875991512,2cyclictest16909-21kworker/u8:211:50:050
12875991512,2cyclictest10561-21kworker/u8:210:00:050
1287599150,3cyclictest1481-21ssh09:49:230
1287899140,2cyclictest0-21swapper/312:10:153
1287899140,2cyclictest0-21swapper/311:49:113
1287899140,13cyclictest0-21swapper/311:25:143
1287899140,12cyclictest0-21swapper/311:35:343
12877991411,2cyclictest2644-21kworker/u8:112:22:052
12877991411,2cyclictest18086-21kworker/u8:110:14:062
12877991411,2cyclictest0-21swapper/211:10:582
12877991411,2cyclictest0-21swapper/209:25:172
1287799140,3cyclictest883-21sh12:06:042
1287799140,3cyclictest0-21swapper/212:34:452
1287799140,2cyclictest9199-21ssh11:40:252
1287799140,2cyclictest0-21swapper/210:54:072
1287799140,2cyclictest0-21swapper/210:40:272
1287799140,2cyclictest0-21swapper/209:24:472
1287799140,13cyclictest0-21swapper/212:25:472
1287799140,13cyclictest0-21swapper/210:18:042
1287799140,13cyclictest0-21swapper/209:54:572
1287799140,12cyclictest29247-21diskmemload10:22:362
1287799140,12cyclictest29247-21diskmemload09:39:212
1287799140,12cyclictest13089-21apt-get07:10:102
1287799140,12cyclictest0-21swapper/210:01:322
12876991411,2cyclictest29247-21diskmemload11:59:291
12876991411,2cyclictest29247-21diskmemload11:59:281
12876991411,2cyclictest2766-21apt-get11:00:131
12876991411,2cyclictest0-21swapper/112:39:281
12876991411,2cyclictest0-21swapper/110:29:581
12876991410,2cyclictest0-21swapper/111:40:001
12876991410,2cyclictest0-21swapper/110:20:161
1287699140,13cyclictest0-21swapper/111:15:181
1287699140,12cyclictest20042-21ntpq07:25:181
1287699140,12cyclictest12221-21ntp_states08:25:171
1287699140,12cyclictest0-21swapper/109:40:061
1287699140,12cyclictest0-21swapper/109:38:001
12875991411,2cyclictest29502-21kworker/u8:008:20:060
12875991411,2cyclictest29247-21diskmemload10:35:150
12875991411,2cyclictest28741-21kworker/u8:210:32:040
12875991411,2cyclictest1383-21kworker/u8:211:34:040
12875991411,2cyclictest10561-21kworker/u8:210:08:050
1287599140,13cyclictest7623-1kworker/u9:011:41:160
1287599140,13cyclictest0-21swapper/011:14:040
1287599140,12cyclictest29247-21diskmemload10:10:430
1287599140,12cyclictest21688-21cpuspeed_turbos08:50:140
1287599140,12cyclictest0-21swapper/012:39:570
1287599140,12cyclictest0-21swapper/012:30:160
1287599140,12cyclictest0-21swapper/012:25:370
1287599140,12cyclictest0-21swapper/012:21:550
1287599140,12cyclictest0-21swapper/012:04:000
1287599140,12cyclictest0-21swapper/012:03:590
1287599140,12cyclictest0-21swapper/011:28:480
1287599140,12cyclictest0-21swapper/009:50:370
1287599140,12cyclictest0-21swapper/009:25:140
1287599140,12cyclictest0-21swapper/009:15:130
1287899138,3cyclictest17325-21ssh11:50:073
1287899138,3cyclictest17325-21ssh11:50:073
1287899138,3cyclictest15440-21taskset12:21:423
1287899138,3cyclictest0-21swapper/307:45:143
1287899132,7cyclictest0-21swapper/309:30:003
1287899132,6cyclictest0-21swapper/308:30:013
12878991310,2cyclictest15733-21ssh10:04:343
12878991310,2cyclictest0-21swapper/312:15:133
12878991310,2cyclictest0-21swapper/311:13:203
12878991310,2cyclictest0-21swapper/310:58:103
12878991310,2cyclictest0-21swapper/310:39:583
12878991310,2cyclictest0-21swapper/309:15:093
12878991310,2cyclictest0-21swapper/309:14:523
1287899130,2cyclictest0-21swapper/311:42:193
1287899130,2cyclictest0-21swapper/311:30:333
1287899130,2cyclictest0-21swapper/310:50:053
1287899130,2cyclictest0-21swapper/310:30:163
1287899130,2cyclictest0-21swapper/309:51:113
1287899130,12cyclictest0-21swapper/312:35:513
1287899130,12cyclictest0-21swapper/312:01:033
1287899130,12cyclictest0-21swapper/312:01:033
1287899130,12cyclictest0-21swapper/311:57:483
1287899130,12cyclictest0-21swapper/311:57:483
1287899130,12cyclictest0-21swapper/310:27:443
1287899130,12cyclictest0-21swapper/309:40:013
1287899130,12cyclictest0-21swapper/309:26:143
1287899130,12cyclictest0-21swapper/308:45:123
1287899130,12cyclictest0-21swapper/308:10:113
1287899130,11cyclictest29247-21diskmemload10:11:193
1287899130,11cyclictest29247-21diskmemload10:08:043
1287899130,11cyclictest0-21swapper/312:27:223
12877991310,2cyclictest15737-21kworker/u8:211:00:042
12877991310,2cyclictest0-21swapper/211:07:322
12877991310,2cyclictest0-21swapper/210:45:362
12877991310,2cyclictest0-21swapper/210:06:252
12877991310,2cyclictest0-21swapper/209:41:032
12877991310,2cyclictest0-21swapper/209:15:222
12877991310,2cyclictest0-21swapper/207:45:172
1287799130,2cyclictest0-21swapper/211:55:242
1287799130,2cyclictest0-21swapper/211:55:232
1287799130,2cyclictest0-21swapper/210:55:112
1287799130,2cyclictest0-21swapper/210:25:062
1287799130,2cyclictest0-21swapper/209:47:182
1287799130,2cyclictest0-21swapper/209:30:192
1287799130,2cyclictest0-21swapper/208:05:142
1287799130,12cyclictest0-21swapper/211:27:282
1287799130,12cyclictest0-21swapper/211:15:352
1287799130,12cyclictest0-21swapper/209:05:162
1287799130,12cyclictest0-21swapper/209:00:232
1287799130,12cyclictest0-21swapper/207:55:262
1287799130,12cyclictest0-21swapper/207:15:132
1287799130,11cyclictest0-21swapper/212:10:182
1287699139,2cyclictest3963-21ntp_states08:05:191
1287699132,8cyclictest29247-21diskmemload10:10:251
12876991310,2cyclictest0-21swapper/111:46:281
12876991310,2cyclictest0-21swapper/111:30:141
1287699130,9cyclictest0-21swapper/108:23:591
1287699130,6cyclictest5906-21metacity10:05:581
1287699130,2cyclictest18240-21fschecks_count12:25:161
1287699130,2cyclictest0-21swapper/111:05:011
1287699130,2cyclictest0-21swapper/110:45:201
1287699130,2cyclictest0-21swapper/109:56:281
1287699130,2cyclictest0-21swapper/109:50:161
1287699130,2cyclictest0-21swapper/109:30:281
1287699130,2cyclictest0-21swapper/107:54:591
1287699130,12cyclictest0-21swapper/111:27:491
1287699130,12cyclictest0-21swapper/110:31:381
1287699130,12cyclictest0-21swapper/110:00:081
1287699130,12cyclictest0-21swapper/109:22:501
1287699130,12cyclictest0-21swapper/108:35:241
1287699130,12cyclictest0-21swapper/107:45:151
1287699130,11cyclictest0-21swapper/109:46:101
1287699130,11cyclictest0-21swapper/108:40:131
12875991310,2cyclictest29725-21kworker/u8:109:20:040
12875991310,2cyclictest29247-21diskmemload12:08:220
12875991310,2cyclictest21499-21kworker/u8:009:10:050
12875991310,2cyclictest0-21swapper/011:22:250
12875991310,2cyclictest0-21swapper/010:45:150
12875991310,2cyclictest0-21swapper/010:25:460
12875991310,2cyclictest0-21swapper/010:20:250
12875991310,2cyclictest0-21swapper/008:10:190
1287599130,2cyclictest0-21swapper/011:46:370
1287599130,2cyclictest0-21swapper/010:41:420
1287599130,2cyclictest0-21swapper/007:10:100
1287599130,12cyclictest29247-21diskmemload11:19:250
1287599130,12cyclictest0-21swapper/011:56:270
1287599130,12cyclictest0-21swapper/011:56:270
1287599130,12cyclictest0-21swapper/011:01:060
1287599130,12cyclictest0-21swapper/010:50:120
1287599130,12cyclictest0-21swapper/009:59:570
1287599130,12cyclictest0-21swapper/009:30:270
1287599130,12cyclictest0-21swapper/007:30:120
1287599130,11cyclictest29247-21diskmemload09:42:190
1287899127,3cyclictest0-21swapper/307:35:163
1287899122,7cyclictest5911-21gdm-simple-gree08:39:583
1287899122,7cyclictest0-21swapper/308:57:593
1287899122,7cyclictest0-21swapper/307:54:593
1287899122,6cyclictest0-21swapper/309:05:253
1287899121,7cyclictest0-21swapper/307:15:263
1287899121,5cyclictest0-21swapper/307:45:013
1287899120,2cyclictest0-21swapper/310:46:203
1287899120,11cyclictest0-21swapper/309:23:003
1287899120,11cyclictest0-21swapper/308:20:183
1287899120,11cyclictest0-21swapper/308:00:133
1287899120,11cyclictest0-21swapper/307:25:173
1287799129,2cyclictest22771-21kworker/u8:207:53:042
1287799129,2cyclictest0-21swapper/207:25:182
1287799120,2cyclictest0-21swapper/208:10:172
1287799120,11cyclictest0-21swapper/208:35:252
1287799120,11cyclictest0-21swapper/207:30:162
1287699129,2cyclictest0-21swapper/111:20:231
1287699129,2cyclictest0-21swapper/109:25:561
1287699129,2cyclictest0-21swapper/109:10:281
1287699122,7cyclictest0-21swapper/109:00:011
1287699122,7cyclictest0-21swapper/107:17:581
1287699122,7cyclictest0-21swapper/107:11:581
1287699121,9cyclictest26775-21grep07:40:271
1287699120,2cyclictest0-21swapper/112:07:141
1287699120,2cyclictest0-21swapper/111:10:061
1287699120,2cyclictest0-21swapper/110:55:491
1287699120,2cyclictest0-21swapper/110:50:311
1287699120,11cyclictest0-21swapper/112:31:251
1287699120,11cyclictest0-21swapper/112:17:041
1287699120,11cyclictest0-21swapper/111:50:181
1287699120,11cyclictest0-21swapper/111:50:171
1287699120,11cyclictest0-21swapper/110:15:461
1287699120,10cyclictest0-21swapper/110:40:191
1287599120,2cyclictest0-21swapper/008:55:180
1287599120,11cyclictest0-21swapper/012:11:470
1287599120,11cyclictest0-21swapper/009:09:250
1287599120,11cyclictest0-21swapper/008:30:140
1287599120,11cyclictest0-21swapper/008:05:150
1287599120,11cyclictest0-21swapper/007:35:210
1287899116,3cyclictest32114-21ethtool07:55:153
1287899111,7cyclictest0-21swapper/308:53:583
1287899110,10cyclictest0-21swapper/308:05:233
1287799118,2cyclictest21499-21kworker/u8:008:51:042
1287799118,2cyclictest18902-21kworker/u8:108:57:052
1287699112,6cyclictest0-21swapper/107:31:591
1287699111,2cyclictest23229-21apt-get07:35:111
1287699110,9cyclictest0-21swapper/108:50:121
1287699110,9cyclictest0-21swapper/108:10:251
1287699110,10cyclictest0-21swapper/108:00:241
1287599118,2cyclictest0-21swapper/008:35:250
284002100,2sleep00-21swapper/007:45:190
1287899102,6cyclictest13334-21grep07:10:123
1287799107,2cyclictest29502-21kworker/u8:008:19:042
1287799107,2cyclictest2828-21kworker/u8:108:25:042
1287699105,3cyclictest23674-21tr08:55:161
1287699102,7cyclictest0-21swapper/108:30:011
1287699101,2cyclictest17132-21munin-node1
1287699100,8cyclictest27450-21munin-node1
1287699100,8cyclictest20335-21proc_pri08:45:191
1287699100,2cyclictest0-21swapper/108:15:121
1287599107,2cyclictest19302-21kworker/u8:107:29:040
1287599107,2cyclictest13218-21kworker/u8:007:21:050
1287599107,2cyclictest0-21swapper/009:01:250
1287599107,2cyclictest0-21swapper/008:45:140
1287599107,2cyclictest0-21swapper/008:25:250
1287599107,2cyclictest0-21swapper/007:55:150
2614290,2sleep00-21swapper/008:02:160
19096290,2sleep20-21swapper/208:44:092
128789994,3cyclictest7726-21tune2fs08:15:143
128789994,3cyclictest5129-21runrttasks07:33:463
128789994,3cyclictest278-21jbd2/sda1-807:20:063
128789994,3cyclictest0-21swapper/309:00:133
128789991,3cyclictest0-21swapper/308:25:153
128779996,2cyclictest0-21swapper/208:30:132
128779993,5cyclictest278-21jbd2/sda1-807:36:142
128779991,6cyclictest6988-21kworker/2:007:20:182
128779990,2cyclictest0-21swapper/208:20:052
128769990,8cyclictest31472-21munin-node1
128759996,2cyclictest9474-21kworker/u8:208:40:040
128759990,8cyclictest0-21swapper/007:40:140
31189280,2sleep00-21swapper/007:54:150
128779981,3cyclictest2155-21python08:00:222
128759985,2cyclictest0-21swapper/008:15:440
128759980,7cyclictest0-21swapper/007:16:460
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional