Ok, as you know you can double click a value on a pivot table to see the data details but what if you click on a chart?
Since it is a collection of all the data, you can’t see the data behind it, however this macro code will allow you to go to the pivot table driving the chart.

Sub gotopivottable()
'****GO TO SOURCE PIVOT OF CLICKED CHART****
'rodericke.com/excel
Dim pvt As PivotTable
Dim actsh As Worksheet
Set actsh = ActiveSheet
Set pvt = actsh.ChartObjects(Application.Caller).Chart.PivotLayout.PivotTable
pvt.Parent.Activate
pvt.TableRange2.Cells(1).Select
MsgBox "Double click any value within this pivot table to see data details", vbInformation, "ALERT"
'MsgBox pvt.Name & " is on " & pvt.Parent.Name & " using data from " & actsh.ChartObjects(Application.Caller).Chart.SeriesCollection(1).Formula 'uncomment to show msg about source pivot
End Sub

Add that macro and then right click ANY chart and Assign it to the macro. Now when you click the chart, you’ll go to the sheet with the pivot table.

DRAWBACK:
You’ll have to right-click to change elements within a chart.