You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-12 - 10:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Thu Sep 12, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7298211994,18sleep00-21swapper/019:06:140
73362117106,6sleep10-21swapper/119:06:431
1517521130,0sleep20-21swapper/200:21:562
7270211193,13sleep20-21swapper/219:05:522
7451210481,18sleep30-21swapper/319:08:143
203302860,2sleep3381ktimersoftd/321:39:153
196332780,0sleep20-21swapper/223:20:072
120692760,4sleep3762099cyclictest20:40:133
209772750,0sleep20-21swapper/200:28:292
327122730,0sleep00-21swapper/021:51:020
234512730,0sleep00-21swapper/000:30:240
54502640,0sleep30-21swapper/321:56:183
177232620,1sleep20-21swapper/222:10:122
13212580,1sleep1761799cyclictest23:34:531
761799220,3cyclictest1438-21sh21:20:111
761799220,3cyclictest0-21swapper/120:25:161
761799220,3cyclictest0-21swapper/120:25:161
761799211,11cyclictest441-21ssh00:06:441
761799210,4cyclictest23829-21diskmemload00:40:001
761799210,3cyclictest30963-21ssh21:16:051
761799210,3cyclictest24224-21egrep19:50:121
761799210,3cyclictest0-21swapper/123:26:281
761799210,3cyclictest0-21swapper/100:30:161
761799210,2cyclictest0-21swapper/119:40:121
761799210,2cyclictest0-21swapper/100:15:211
761799210,13cyclictest203450irq/24-eth121:51:021
129532210,1sleep10-21swapper/119:20:241
761999200,2cyclictest0-21swapper/221:30:122
761799209,9cyclictest15996-21chrt20:50:111
761799201,3cyclictest32106-21munin-node1
761799201,3cyclictest26027-21munin-node1
761799201,3cyclictest14146-21grep00:20:241
761799201,3cyclictest0-21swapper/121:10:071
761799201,3cyclictest0-21swapper/121:00:131
761799200,5cyclictest0-21swapper/122:01:321
761799200,4cyclictest0-21swapper/122:11:281
761799200,3cyclictest8648-21ls20:30:171
761799200,3cyclictest24682-21sh22:16:361
761799200,3cyclictest11672-21sendmail-msp19:20:001
761799200,3cyclictest0-21swapper/123:35:161
761799200,3cyclictest0-21swapper/123:11:481
761799200,3cyclictest0-21swapper/123:05:251
761799200,3cyclictest0-21swapper/122:30:001
761799200,3cyclictest0-21swapper/122:20:131
761799200,3cyclictest0-21swapper/120:55:131
761799200,2cyclictest0-21swapper/123:44:321
761699200,18cyclictest0-21swapper/023:00:090
761699200,18cyclictest0-21swapper/020:40:110
7620991916,2cyclictest2126-21kworker/u8:223:02:033
762099190,18cyclictest0-21swapper/319:25:123
761799191,3cyclictest0-21swapper/120:05:131
761799191,3cyclictest0-21swapper/100:11:041
761799190,3cyclictest8219-21df_inode19:10:131
761799190,3cyclictest18764-21switchtime00:25:261
761799190,3cyclictest10012-21memory22:35:161
761799190,3cyclictest0-21swapper/123:50:161
761799190,3cyclictest0-21swapper/123:45:171
761799190,2cyclictest0-21swapper/123:23:211
761799190,17cyclictest0-21swapper/122:42:221
761799190,12cyclictest7733-21ssh22:33:141
761699190,18cyclictest0-21swapper/020:55:100
761799181,3cyclictest0-21swapper/122:46:531
761799181,3cyclictest0-21swapper/121:25:151
761799181,3cyclictest0-21swapper/119:45:161
761799181,3cyclictest0-21swapper/119:35:281
761799181,15cyclictest0-21swapper/120:00:191
761799180,3cyclictest3745-21runrttasks20:35:521
761799180,3cyclictest18597-21sh23:18:481
761799180,3cyclictest0-21swapper/119:30:151
761799180,2cyclictest23829-21diskmemload00:01:271
761799180,2cyclictest0-21swapper/123:04:521
761799180,2cyclictest0-21swapper/122:55:361
761799180,2cyclictest0-21swapper/122:55:361
761799180,2cyclictest0-21swapper/121:46:341
761799180,16cyclictest0-21swapper/122:50:021
761799180,11cyclictest0-21swapper/122:09:361
761699180,3cyclictest11596-21kworker/0:122:16:050
291452180,1sleep20-21swapper/200:03:242
761799175,3cyclictest21365-21aten2.4_r3power21:40:131
761799174,3cyclictest3589-21df21:55:141
761799170,2cyclictest23829-21diskmemload21:32:301
761799170,2cyclictest0-21swapper/121:37:371
761799170,15cyclictest0-21swapper/123:55:121
761799170,15cyclictest0-21swapper/120:20:151
7616991714,2cyclictest8305-21kworker/u8:122:52:050
207522170,0sleep30-21swapper/319:40:183
762099160,3cyclictest14200-21cpuspeed_turbos22:40:123
762099160,2cyclictest0-21swapper/322:28:043
762099160,2cyclictest0-21swapper/322:16:053
762099160,14cyclictest0-21swapper/323:40:113
761799165,2cyclictest0-21swapper/120:40:241
761799160,3cyclictest0-21swapper/120:15:111
7616991612,2cyclictest0-21swapper/022:42:410
761699160,2cyclictest2680-21ssh22:28:040
761699160,2cyclictest23829-21diskmemload00:02:050
761699160,10cyclictest0-21swapper/023:21:050
7620991512,2cyclictest8305-21kworker/u8:122:08:043
7620991512,2cyclictest32207-21kworker/u8:223:45:053
762099150,2cyclictest0-21swapper/300:02:053
761999152,7cyclictest0-21swapper/221:05:002
7619991510,3cyclictest0-21swapper/221:48:152
7619991510,3cyclictest0-21swapper/220:05:362
7619991510,3cyclictest0-21swapper/200:30:142
761999150,13cyclictest32407-21fschecks_count22:25:152
761999150,13cyclictest0-21swapper/222:07:462
761799156,1cyclictest0-21swapper/120:45:111
761799151,4cyclictest22299-21tr21:05:121
761799151,3cyclictest14379-21fschecks_time19:25:151
7616991512,2cyclictest32207-21kworker/u8:223:34:050
7616991512,2cyclictest23829-21diskmemload21:47:520
7616991512,2cyclictest10159-21kworker/u8:221:30:050
761699151,12cyclictest13667-21iostat_ios22:05:160
761699150,13cyclictest23829-21diskmemload22:10:420
761699150,13cyclictest0-21swapper/022:38:110
761699150,13cyclictest0-21swapper/022:32:010
761699150,13cyclictest0-21swapper/019:40:150
7620991411,2cyclictest26263-21kworker/u8:023:27:053
7620991411,2cyclictest0-21swapper/323:39:203
7620991410,2cyclictest0-21swapper/322:23:423
762099140,12cyclictest0-21swapper/323:30:223
762099140,12cyclictest0-21swapper/323:19:103
762099140,12cyclictest0-21swapper/322:00:083
762099140,12cyclictest0-21swapper/321:33:353
762099140,12cyclictest0-21swapper/321:28:013
762099140,12cyclictest0-21swapper/321:13:043
762099140,12cyclictest0-21swapper/320:50:113
762099140,12cyclictest0-21swapper/300:35:293
762099140,12cyclictest0-21swapper/300:20:243
762099140,12cyclictest0-21swapper/300:16:513
761999149,3cyclictest23829-21diskmemload22:47:562
761999142,6cyclictest0-21swapper/221:25:012
761999142,6cyclictest0-21swapper/200:35:002
7619991411,2cyclictest0-21swapper/222:03:242
7619991410,2cyclictest23829-21diskmemload22:51:372
7619991410,2cyclictest0-21swapper/221:40:132
7619991410,2cyclictest0-21swapper/219:40:142
761999140,7cyclictest0-21swapper/200:09:582
761999140,12cyclictest23829-21diskmemload23:50:162
761999140,12cyclictest23829-21diskmemload22:20:182
761999140,12cyclictest23829-21diskmemload00:10:082
761999140,12cyclictest18089-21aten2.4-expect20:55:102
761999140,12cyclictest0-21swapper/223:47:022
761999140,12cyclictest0-21swapper/222:44:362
761999140,12cyclictest0-21swapper/221:23:592
7616991411,2cyclictest0-21swapper/023:45:130
7616991411,2cyclictest0-21swapper/022:45:010
7616991411,2cyclictest0-21swapper/019:45:120
7616991411,2cyclictest0-21swapper/000:36:410
761699141,11cyclictest23829-21diskmemload21:10:030
7616991410,2cyclictest0-21swapper/021:42:000
761699140,2cyclictest0-21swapper/023:39:110
761699140,2cyclictest0-21swapper/023:25:110
761699140,2cyclictest0-21swapper/023:15:410
761699140,2cyclictest0-21swapper/000:25:110
761699140,13cyclictest9697-21ssh21:28:010
761699140,13cyclictest0-21swapper/023:50:410
761699140,13cyclictest0-21swapper/020:05:220
761699140,12cyclictest0-21swapper/023:05:140
761699140,12cyclictest0-21swapper/021:36:210
761699140,12cyclictest0-21swapper/000:20:230
76932130,1sleep20-21swapper/223:06:332
7620991310,2cyclictest23950-21kworker/u8:300:31:043
7620991310,2cyclictest0-21swapper/323:58:343
7620991310,2cyclictest0-21swapper/323:10:303
7620991310,2cyclictest0-21swapper/322:45:093
7620991310,2cyclictest0-21swapper/322:30:053
7620991310,2cyclictest0-21swapper/322:12:083
7620991310,2cyclictest0-21swapper/321:51:073
7620991310,2cyclictest0-21swapper/321:20:313
7620991310,2cyclictest0-21swapper/320:25:263
7620991310,2cyclictest0-21swapper/320:25:263
7620991310,2cyclictest0-21swapper/300:12:583
762099130,2cyclictest0-21swapper/323:24:393
762099130,2cyclictest0-21swapper/323:05:093
762099130,2cyclictest0-21swapper/319:35:003
762099130,12cyclictest0-21swapper/323:51:113
762099130,12cyclictest0-21swapper/322:55:173
762099130,12cyclictest0-21swapper/322:55:163
762099130,12cyclictest0-21swapper/322:50:493
762099130,12cyclictest0-21swapper/321:00:163
762099130,12cyclictest0-21swapper/320:15:253
762099130,11cyclictest0-21swapper/321:45:373
762099130,11cyclictest0-21swapper/300:26:123
761999133,6cyclictest0-21swapper/219:37:502
7619991310,2cyclictest0-21swapper/223:25:132
7619991310,2cyclictest0-21swapper/223:19:542
7619991310,2cyclictest0-21swapper/221:51:182
7619991310,2cyclictest0-21swapper/221:37:272
761999130,2cyclictest0-21swapper/222:58:242
761999130,2cyclictest0-21swapper/222:58:242
761999130,2cyclictest0-21swapper/200:17:152
761999130,12cyclictest0-21swapper/223:36:382
761999130,12cyclictest0-21swapper/223:30:142
761999130,12cyclictest0-21swapper/222:35:432
761999130,12cyclictest0-21swapper/222:30:182
761999130,12cyclictest0-21swapper/221:15:092
761999130,11cyclictest0-21swapper/223:02:062
761999130,11cyclictest0-21swapper/222:15:002
7616991310,2cyclictest5941-21kworker/u8:120:28:040
7616991310,2cyclictest5941-21kworker/u8:120:28:040
7616991310,2cyclictest27823-21kworker/u8:022:04:050
7616991310,2cyclictest0-21swapper/023:41:240
7616991310,2cyclictest0-21swapper/022:57:510
7616991310,2cyclictest0-21swapper/022:57:510
7616991310,2cyclictest0-21swapper/022:21:140
761699130,2cyclictest0-21swapper/023:55:180
761699130,2cyclictest0-21swapper/000:06:520
761699130,12cyclictest0-21swapper/021:17:310
761699130,12cyclictest0-21swapper/020:50:250
761699130,12cyclictest0-21swapper/000:16:310
761699130,11cyclictest23829-21diskmemload23:10:140
762099129,2cyclictest16638-21kworker/u8:119:35:043
762099129,2cyclictest13987-21kworker/u8:121:15:033
762099129,2cyclictest0-21swapper/319:15:123
762099122,5cyclictest0-21swapper/319:15:003
762099120,2cyclictest0-21swapper/321:40:473
762099120,11cyclictest0-21swapper/322:37:003
762099120,11cyclictest0-21swapper/320:35:183
762099120,11cyclictest0-21swapper/319:50:163
762099120,11cyclictest0-21swapper/300:05:173
761999129,2cyclictest0-21swapper/223:10:182
761999129,2cyclictest0-21swapper/221:11:432
761999129,2cyclictest0-21swapper/220:20:262
761999129,2cyclictest0-21swapper/219:15:242
761999122,7cyclictest0-21swapper/223:56:012
761999122,7cyclictest0-21swapper/220:40:592
761999122,6cyclictest0-21swapper/221:05:242
761999122,6cyclictest0-21swapper/219:30:232
761999120,11cyclictest0-21swapper/223:40:082
761999120,11cyclictest0-21swapper/221:55:172
761999120,11cyclictest0-21swapper/219:25:282
761699129,2cyclictest0-21swapper/021:20:260
761699129,2cyclictest0-21swapper/000:12:000
761699128,3cyclictest0-21swapper/020:30:110
761699120,7cyclictest0-21swapper/021:05:050
761699120,2cyclictest0-21swapper/020:45:150
761699120,2cyclictest0-21swapper/019:50:160
761699120,11cyclictest23829-21diskmemload21:57:310
762099118,2cyclictest9535-21kworker/u8:220:55:033
762099118,2cyclictest0-21swapper/320:10:143
762099118,2cyclictest0-21swapper/320:00:123
762099110,2cyclictest0-21swapper/320:30:113
761999116,3cyclictest16563-21grep20:50:142
761999112,7cyclictest0-21swapper/219:13:022
761999111,6cyclictest0-21swapper/220:25:112
761999111,6cyclictest0-21swapper/220:25:112
761699118,2cyclictest21974-21kworker/u8:020:24:040
761699118,2cyclictest16638-21kworker/u8:119:31:040
761699118,2cyclictest14057-21kworker/u8:019:29:050
761699118,2cyclictest0-21swapper/020:00:130
761699110,10cyclictest0-21swapper/019:20:170
218092110,2sleep30-21swapper/321:05:023
762099107,2cyclictest3362-21kworker/u8:220:20:053
762099107,2cyclictest16638-21kworker/u8:119:49:043
762099100,7cyclictest0-21swapper/319:21:043
762099100,2cyclictest0-21swapper/319:57:043
761999105,3cyclictest3011-21nscd19:55:232
761999104,4cyclictest13236-21tail19:20:272
761999101,6cyclictest0-21swapper/220:45:012
761999101,6cyclictest0-21swapper/220:32:592
761999101,6cyclictest0-21swapper/220:10:162
761999100,7cyclictest0-21swapper/220:15:012
761999100,7cyclictest0-21swapper/219:54:012
761699107,2cyclictest8338-21kworker/u8:319:14:050
761699107,2cyclictest21974-21kworker/u8:020:11:040
761699107,2cyclictest0-21swapper/019:55:100
761699105,3cyclictest9974-21aten2.4-expect19:15:110
761699105,3cyclictest19750irq/25-ahci[00019:40:010
34022100,2sleep00-21swapper/020:18:460
76209994,3cyclictest8426-21nscd20:05:083
76209990,8cyclictest0-21swapper/320:45:213
76199994,3cyclictest23501-21sshd19:46:152
76199994,3cyclictest11738-21grep20:40:002
76199990,6cyclictest0-21swapper/220:00:242
76169996,2cyclictest9535-21kworker/u8:220:35:050
76169983,3cyclictest20784-21cat21:00:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional